00000001:02000400:3.0F:1789048285.981905:0:3294:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1789048296.726543:0:3497:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1789048298.671988:0:3559:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 443 MB/s 00000001:01000000:2.0:1789048298.924314:0:3559:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 468 MB/s 00000001:01000000:2.0:1789048299.176727:0:3559:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3984 MB/s 00000020:02000000:1.0:1789048299.970100:0:3588:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_40_gb4686d2 00000400:02000000:1.0:1789048301.020467:0:3603:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.116@tcp [8/256/0/180] 00008000:02000000:0.0F:1789048305.231387:0:3753:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789048377.646028:0:5723:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789048393.571576:0:6473:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789048393.571585:0:6473:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1789048393.571586:0:6473:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789048393.571720:0:6473:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000051288f6b 00000080:02000400:1.0:1789048393.571731:0:6473:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1789048393.586514:0:6473:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789048393.586527:0:6473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789048393.586568:0:6473:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000096ebe3aa) 00000020:00000080:1.0:1789048393.586588:0:6473:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789048393.657294:0:6473:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789048393.657399:0:6473:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1789048393.684114:0:6473:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789048393.684392:0:6473:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789048393.684401:0:6473:0:(osd_handler.c:8921:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789048393.684414:0:6473:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c087758eb 00000020:01000004:3.0:1789048393.684421:0:6473:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789048393.684426:0:6473:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789048393.684431:0:6473:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000051288f6b from MGS 00000020:01000004:3.0:1789048393.684435:0:6473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789048393.684452:0:6473:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000005bb39dde) 00000020:00000080:3.0:1789048393.684463:0:6473:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789048393.684573:0:6473:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000051288f6b from MGS, refs=2 00080000:01000000:3.0:1789048393.684580:0:6473:0:(osd_handler.c:8921:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789048393.684585:0:6473:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c087758f9 00000100:00100000:3.0:1789048393.684676:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789048393.684811:0:6473:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789048393.684817:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789048393.699975:0:6473:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789048393.699990:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789048393.701219:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789048393.701680:0:6473:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789048393.701686:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789048393.702623:0:6473:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789048393.702633:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789048393.705215:0:6473:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789048393.705228:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789048393.706808:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048393.706813:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048393.706815:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048393.707710:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048393.707714:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048393.707716:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048393.708591:0:6473:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789048393.725188:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789048393.957621:0:6473:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2967 MB/s 00000001:01000000:0.0:1789048394.212206:0:6473:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2759 MB/s 00000001:01000000:1.0:1789048394.461794:0:6473:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 471 MB/s 00000001:01000000:2.0:1789048394.711713:0:6473:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 500 MB/s 00010000:00010000:0.0:1789048394.723985:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1789048394.730910:0:6473:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1789048394.768001:0:6473:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1789048394.787575:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789048394.788408:0:6473:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789048394.788494:0:6473:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789048394.788762:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789048394.788787:0:6473:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789048394.789118:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789048394.790962:0:6473:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789048394.790973:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789048394.792912:0:6473:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789048394.792923:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789048394.799397:0:6473:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789048394.799411:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789048394.802366:0:6473:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789048394.802440:0:6473:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.116@tcp' 00000020:01000004:0.0:1789048394.802442:0:6473:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789048394.802526:0:6473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.116@tcp (typ=mgc) 00000100:00080000:1.0:1789048394.808128:0:6493:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1789048394.817374:0:6473:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.116@tcp (00000000803730c3) 00000020:00000080:0.0:1789048394.817409:0:6473:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789048394.817527:0:6473:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cfdba88c@MGC192.168.202.116@tcp: add connection 192.168.202.116@tcp at head 00010000:00010000:0.0:1789048394.817684:0:6473:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.116@tcp-0 is initialized 00000040:01000000:0.0:1789048394.817690:0:6473:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789048394.822207:0:6494:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789048394.822901:0:6473:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.116@tcp (uuid 17f7b908-b8ce-4c14-97e3-2e83ca6f061b) 00000020:00000080:1.0:1789048394.822931:0:6473:0:(genops.c:1384:class_connect()) connect: client 17f7b908-b8ce-4c14-97e3-2e83ca6f061b, cookie 0x133f221c08775907 00000100:00080000:1.0:1789048394.822946:0:6473:0:(import.c:545:import_select_connection()) MGC192.168.202.116@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789048394.822956:0:6473:0:(import.c:666:import_select_connection()) MGC192.168.202.116@tcp: import 00000000cfdba88c using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048394.823171:0:6473:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f682c0c9 x1875953111269504/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789048394.823202:0:6473:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 17f7b908-b8ce-4c14-97e3-2e83ca6f061b->MGS 00000020:01000004:1.0:1789048394.823221:0:6473:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789048394.823227:0:6473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789048394.823243:0:6473:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000030e773b2) 00000020:00000080:1.0:1789048394.823257:0:6473:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789048394.824319:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f682c0c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3619:1875953111269504:0@lo:250: 00000100:00100000:2.0:1789048394.824419:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048394.824658:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111269504 00000100:00100000:3.0:1789048394.824666:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111269504 00000100:00100000:3.0:1789048394.824702:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789048394.824709:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e28c6402 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3619:x1875953111269504:12345-0@lo:250: 00010000:00080000:3.0:1789048394.824737:0:6490:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 17f7b908-b8ce-4c14-97e3-2e83ca6f061b@0@lo t0 exp 0000000000000000 cur 149 last 0 00000020:00000080:3.0:1789048394.824769:0:6490:0:(genops.c:1384:class_connect()) connect: client 17f7b908-b8ce-4c14-97e3-2e83ca6f061b, cookie 0x133f221c08775915 00000100:00080000:3.0:1789048394.824903:0:6490:0:(import.c:65:import_set_state_nolock()) 00000000dd4acc7c : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789048394.824983:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e28c6402 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+5:3619:x1875953111269504:12345-0@lo:250: Request processed in 273us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048394.824992:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789048394.826254:0:3619:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.116@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789048394.826268:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.116@tcp: connect to target with instance 0 00000100:00080000:3.0:1789048394.826275:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.116@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789048394.826280:0:3619:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789048394.826283:0:3619:0:(import.c:65:import_set_state_nolock()) 00000000cfdba88c MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789048394.826287:0:3619:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789048394.826300:0:3619:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789048394.826307:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f682c0c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3619:1875953111269504:0@lo:250: 00000100:00100000:0.0:1789048394.857382:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789048394.857624:0:6473:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789048394.857632:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789048394.870469:0:6473:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789048394.870607:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789048394.871110:0:6473:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789048394.871118:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789048394.871918:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789048394.872117:0:6473:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789048394.872123:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789048394.872719:0:6473:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789048394.872727:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789048394.923876:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789048394.924086:0:6473:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789048394.924093:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789048394.925581:0:6473:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789048394.925593:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789048394.926639:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789048394.926818:0:6473:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789048394.926823:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789048394.927550:0:6473:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789048394.927557:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789048394.928170:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789048394.928321:0:6473:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789048394.928326:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789048394.929565:0:6473:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789048394.929575:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789048394.930121:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789048394.930308:0:6473:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789048394.930313:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789048394.930831:0:6473:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789048394.930838:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789048394.966742:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789048394.966957:0:6473:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789048394.966986:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789048394.968280:0:6473:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789048394.968291:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789048394.969106:0:6473:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789048394.969117:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789048394.969918:0:6473:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789048394.969950:0:6473:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1789048394.969958:0:6473:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789048394.970176:0:6473:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789048394.970213:0:6473:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.116@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1789048394.970218:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789048394.970220:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789048394.970221:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048394.970222:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048394.970223:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048394.970225:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048394.970226:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789048394.970228:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789048394.970229:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789048394.970230:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789048394.970232:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048394.970233:0:6473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789048394.970235:0:6473:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1789048394.970237:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789048394.970238:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789048394.970239:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048394.970240:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048394.970241:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048394.970242:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048394.970243:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789048394.970245:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789048394.970251:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789048394.970252:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789048394.970253:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048394.970253:0:6473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789048394.970287:0:6473:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789048394.970303:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c8a7eb28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111269632:0@lo:253: 00000100:00100000:2.0:1789048394.970490:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048394.970574:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set 000000007cbc180f going to sleep for 11 seconds 00000100:00100000:0.0:1789048394.972873:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111269632 00000100:00100000:0.0:1789048394.972887:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111269632 00000100:00100000:0.0:1789048394.972990:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789048394.972999:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c0ba5cbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+5:6473:x1875953111269632:12345-0@lo:253: 20000000:01000000:0.0:1789048394.973578:0:6492:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789048394.973586:0:6492:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789048394.973934:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789048394.973990:0:6492:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789048394.974306:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789048394.975724:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1789048394.975954:0:6492:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789048394.975958:0:6492:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1789048394.975963:0:6492:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1789048394.975966:0:6492:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1789048394.975977:0:6492:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1789048394.976295:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789048394.984081:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1789048394.984117:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789048394.984182:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1789048394.984202:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1789048394.984220:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1789048394.984311:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1789048394.984320:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1789048394.984489:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1789048394.984498:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1789048394.984515:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1789048394.984521:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1789048394.984534:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1789048394.984551:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1789048394.984582:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789048394.984588:0:6492:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1789048394.984596:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789048394.984695:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1789048394.984705:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789048394.984718:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1789048394.984732:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1789048394.984747:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1789048394.984757:0:6492:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1789048394.984783:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1789048394.984792:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789048394.984817:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1789048394.984836:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1789048394.984854:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1789048394.984863:0:6492:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1789048394.984900:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1789048394.984910:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1789048394.984923:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1789048394.984941:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1789048394.985011:0:6492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1789048394.985037:0:6492:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789048394.985042:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789048394.987280:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1789048394.991680:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1789048394.991715:0:6492:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.116@tcp for mdt 20000000:01000000:0.0:1789048394.991718:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:0.0:1789048394.991735:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1789048394.991741:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789048394.991755:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1789048394.991761:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:0.0:1789048394.991772:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1789048394.991780:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789048394.991791:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1789048394.991804:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1789048394.991832:0:6492:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789048394.991834:0:6492:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789048394.991838:0:6492:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789048394.991907:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789048394.991910:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789048394.994272:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789048394.994528:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789048394.994562:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789048394.994580:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1789048394.994593:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789048394.994595:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789048394.994964:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1789048394.995191:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789048394.995215:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1789048394.995234:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1789048394.995246:0:6492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789048394.995248:0:6492:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1789048394.995254:0:6492:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789048394.995257:0:6492:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789048394.995262:0:6492:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789048394.995268:0:6492:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789048394.995763:0:6518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1789048394.995875:0:6492:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1789048395.009734:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1789048395.009779:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1789048395.009798:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1789048395.009822:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789048395.009846:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000038cdb425/0x133f221c0877591c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048395.009864:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038cdb425/0x133f221c0877591c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048395.009874:0:6492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000038cdb425/0x133f221c0877591c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048395.009881:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000038cdb425/0x133f221c0877591c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048395.009887:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000038cdb425/0x133f221c0877591c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048395.009893:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000038cdb425/0x133f221c0877591c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048395.009900:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000038cdb425 already unused, calling callback (0000000072af32a2) 00010000:00010000:1.0:1789048395.009904:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000038cdb425/0x133f221c0877591c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048395.009912:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000038cdb425/0x133f221c0877591c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048395.009924:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000038cdb425/0x133f221c0877591c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048395.009951:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000038cdb425/0x133f221c0877591c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048395.009957:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000038cdb425/0x133f221c0877591c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789048395.009975:0:6492:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789048395.028613:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c0ba5cbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+5:6473:x1875953111269632:12345-0@lo:253: Request processed in 55602us (58111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048395.028648:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789048395.028666:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c8a7eb28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111269632:0@lo:253: 10000000:01000000:3.0:1789048395.028699:0:6473:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789048395.028702:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789048395.028705:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789048395.028707:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789048395.028708:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789048395.028730:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789048395.028732:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789048395.028733:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789048395.028735:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789048395.028736:0:6473:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789048395.028737:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789048395.028739:0:6473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789048395.028762:0:6473:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000051288f6b from lustre-MDT0000 10000000:01000000:3.0:1789048395.028798:0:6473:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789048395.028802:0:6473:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789048395.028807:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff959c394bb380 10000000:01000000:3.0:1789048395.028810:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789048395.028819:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff959c394bb380 from 1 10000000:01000000:3.0:1789048395.028821:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789048395.028888:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 000000006029b2a8/0x133f221c08775923 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.028913:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 000000006029b2a8/0x133f221c08775923 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.028921:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 000000006029b2a8/0x133f221c08775923 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048395.028942:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f328f9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111269760:0@lo:101: 00000100:00100000:3.0:1789048395.029024:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048395.029077:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c7b4cfaa going to sleep for 11 seconds 00000100:00100000:0.0:1789048395.029154:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111269760 00000100:00100000:0.0:1789048395.029162:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111269760 00000100:00100000:0.0:1789048395.029215:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789048395.029231:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e7dffc1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+5:6473:x1875953111269760:12345-0@lo:101: 00010000:00010000:0.0:1789048395.029246:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048395.029260:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000086fe0175/0x133f221c0877592a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775923 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048395.029285:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000086fe0175/0x133f221c0877592a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775923 expref: 6 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048395.029296:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000086fe0175/0x133f221c0877592a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775923 expref: 6 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048395.029306:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000086fe0175, rc 0) 00000100:00100000:0.0:1789048395.029397:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e7dffc1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+6:6473:x1875953111269760:12345-0@lo:101: Request processed in 168us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048395.029403:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789048395.029685:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f328f9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111269760:0@lo:101: 00010000:00010000:3.0:1789048395.029700:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 000000006029b2a8/0x133f221c08775923 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c0877592a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.029709:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 000000006029b2a8/0x133f221c08775923 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c0877592a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048395.029776:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f328f9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111269888:0@lo:501: 00000100:00100000:3.0:1789048395.029804:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048395.029836:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c7b4cfaa going to sleep for 11 seconds 00000100:00100000:2.0:1789048395.029893:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111269888 00000100:00100000:2.0:1789048395.029898:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111269888 00000100:00100000:2.0:1789048395.029949:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789048395.029956:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000061add1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+6:6473:x1875953111269888:12345-0@lo:501: 00000100:00100000:2.0:1789048395.030051:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000061add1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+6:6473:x1875953111269888:12345-0@lo:501: Request processed in 87us (237us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789048395.030057:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789048395.030122:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f328f9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111269888:0@lo:501: 10000000:01000000:3.0:1789048395.030164:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789048395.030185:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 000000006029b2a8/0x133f221c08775923 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c0877592a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.030192:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 000000006029b2a8/0x133f221c08775923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c0877592a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048395.030200:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff959c335d0800 10000000:01000000:3.0:1789048395.030204:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789048395.030208:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff959c335d0800 10000000:01000000:3.0:1789048395.030210:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789048395.030213:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff959c335d0800 from 1 10000000:01000000:3.0:1789048395.030214:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789048395.030231:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 000000008983665b/0x133f221c08775931 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.030236:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 000000008983665b/0x133f221c08775931 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.030243:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 000000008983665b/0x133f221c08775931 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048395.030253:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f328f9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111270016:0@lo:101: 00000100:00100000:3.0:1789048395.030285:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048395.030297:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c7b4cfaa going to sleep for 11 seconds 00000100:00100000:2.0:1789048395.030329:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111270016 00000100:00100000:2.0:1789048395.030365:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111270016 00000100:00100000:2.0:1789048395.030384:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789048395.030389:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5d18f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+6:6473:x1875953111270016:12345-0@lo:101: 00010000:00010000:2.0:1789048395.030406:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048395.030417:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000003db97bb/0x133f221c08775938 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775931 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048395.030433:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000003db97bb/0x133f221c08775938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775931 expref: 7 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048395.030441:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000003db97bb/0x133f221c08775938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775931 expref: 7 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048395.030447:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000003db97bb, rc 0) 00000100:00100000:2.0:1789048395.030486:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5d18f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+7:6473:x1875953111270016:12345-0@lo:101: Request processed in 96us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048395.030492:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789048395.030502:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f328f9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111270016:0@lo:101: 00010000:00010000:3.0:1789048395.030511:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 000000008983665b/0x133f221c08775931 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775938 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.030517:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 000000008983665b/0x133f221c08775931 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775938 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048395.030528:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789048395.030548:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 000000008983665b/0x133f221c08775931 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775938 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.030554:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 000000008983665b/0x133f221c08775931 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775938 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048395.030559:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789048395.030562:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789048395.030566:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff959c335d0800 10000000:01000000:3.0:1789048395.030569:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789048395.030571:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789048395.030573:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789048395.030586:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 000000007a2ea262/0x133f221c0877593f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.030592:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 000000007a2ea262/0x133f221c0877593f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.030599:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 000000007a2ea262/0x133f221c0877593f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048395.030615:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f328f9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111270144:0@lo:101: 00000100:00100000:3.0:1789048395.030639:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048395.030653:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c7b4cfaa going to sleep for 11 seconds 00000100:00100000:3.0:1789048395.030672:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111270144 00000100:00100000:3.0:1789048395.030677:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111270144 00000100:00100000:3.0:1789048395.030694:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789048395.030699:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002abbd05f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+7:6473:x1875953111270144:12345-0@lo:101: 00010000:00010000:3.0:1789048395.030705:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048395.030712:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b103cb41/0x133f221c08775946 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c0877593f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.030725:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b103cb41/0x133f221c08775946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c0877593f expref: 8 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.030731:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b103cb41/0x133f221c08775946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c0877593f expref: 8 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.030737:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b103cb41, rc 0) 00000100:00100000:3.0:1789048395.030773:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002abbd05f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+8:6473:x1875953111270144:12345-0@lo:101: Request processed in 73us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048395.030778:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789048395.030979:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f328f9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111270144:0@lo:101: 00010000:00010000:2.0:1789048395.030992:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 000000007a2ea262/0x133f221c0877593f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775946 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048395.030998:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 000000007a2ea262/0x133f221c0877593f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775946 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048395.031051:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111270272:0@lo:501: 00000100:00100000:2.0:1789048395.031078:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048395.031096:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e09684c7 going to sleep for 11 seconds 00000100:00100000:3.0:1789048395.031465:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111270272 00000100:00100000:3.0:1789048395.031470:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111270272 00000100:00100000:3.0:1789048395.031503:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789048395.031510:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009e388393 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+8:6473:x1875953111270272:12345-0@lo:501: 00000100:00100000:3.0:1789048395.031622:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009e388393 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+9:6473:x1875953111270272:12345-0@lo:501: Request processed in 113us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048395.031639:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789048395.031771:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111270272:0@lo:501: 00000100:00100000:2.0:1789048395.031798:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111270400:0@lo:503: 00000100:00100000:2.0:1789048395.031851:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048395.032070:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e09684c7 going to sleep for 11 seconds 00000100:00100000:0.0:1789048395.035665:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111270400 00000100:00100000:0.0:1789048395.035682:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111270400 00000100:00100000:0.0:1789048395.035756:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789048395.035765:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000010ce4ec8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+9:6473:x1875953111270400:12345-0@lo:503: 00000100:00100000:0.0:1789048395.035951:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000010ce4ec8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+9:6473:x1875953111270400:12345-0@lo:503: Request processed in 187us (4100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048395.035959:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789048395.036219:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111270400:0@lo:503: 00000100:00100000:1.0:1789048395.036715:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d0b7659 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6519:1875953111270528:0@lo:502: 00000100:00100000:1.0:1789048395.036808:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048395.036880:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111270528 00000100:00100000:2.0:1789048395.036887:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111270528 00000100:00100000:2.0:1789048395.036921:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789048395.036929:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002de76eeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+9:6519:x1875953111270528:12345-0@lo:502: 00000100:00100000:2.0:1789048395.037060:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002de76eeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+9:6519:x1875953111270528:12345-0@lo:502: Request processed in 132us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048395.037067:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789048395.037131:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000558ac246 going to sleep for 11 seconds 00000100:00100000:1.0:1789048395.037171:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d0b7659 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6519:1875953111270528:0@lo:502: 00000020:01000000:1.0:1789048395.037280:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048395.037294:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048395.037297:0:6519:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789048395.037302:0:6519:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789048395.037306:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789048395.037325:0:6519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000ccbf2d79) 00000020:00000080:1.0:1789048395.037399:0:6519:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789048395.037407:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789048395.037521:0:6519:0:(osd_handler.c:8921:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789048395.037530:0:6519:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c08775954 00000020:00000080:1.0:1789048395.037805:0:6519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789048395.037810:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048395.037814:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048395.037816:0:6519:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789048395.037825:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048395.037829:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048395.037831:0:6519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789048395.037833:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789048395.037842:0:6519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000048c3548) 00000020:00000080:1.0:1789048395.037852:0:6519:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789048395.037856:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789048395.037858:0:6519:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789048395.037862:0:6519:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789048395.037869:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789048395.038475:0:6519:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000051288f6b from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789048395.038507:0:6519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000d25daa0f) 00000020:00000080:1.0:1789048395.038518:0:6519:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789048395.038623:0:6519:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789048395.038631:0:6519:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x133f221c08775969 00000020:00000080:1.0:1789048395.038761:0:6519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789048395.038768:0:6519:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789048395.038773:0:6519:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x133f221c08775970 00080000:01000000:1.0:1789048395.038778:0:6519:0:(osd_handler.c:8921:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789048395.038782:0:6519:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c08775977 00080000:10000000:1.0:1789048395.039815:0:6519:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1789048395.040131:0:6519:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1789048395.045920:0:6519:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789048395.135021:0:6519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789048395.135885:0:6519:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789048395.141791:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789048395.143187:0:6519:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789048395.149606:0:6519:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ca6fd7bd) 00000020:00000080:3.0:1789048395.149630:0:6519:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789048395.149728:0:6519:0:(osd_handler.c:8921:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789048395.149736:0:6519:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c08775985 00000020:00000080:1.0:1789048395.162826:0:6519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789048395.164860:0:6519:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1789048395.169154:0:6519:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1789048395.178962:0:6519:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1789048395.187416:0:6519:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1789048395.194854:0:6519:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1789048395.196991:0:6519:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1789048395.199770:0:6519:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x133f221c0877598c 00000020:00000080:1.0:1789048395.200110:0:6519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789048395.200124:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048395.200136:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048395.200150:0:6519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789048395.200154:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048395.200158:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048395.200159:0:6519:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789048395.200162:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789048395.200164:0:6519:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789048395.200167:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048395.200170:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048395.200171:0:6519:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789048395.200173:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048395.200178:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048395.200179:0:6519:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789048395.200182:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789048395.200231:0:6519:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1789048395.200290:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d0b7659 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6519:1875953111270656:0@lo:502: 00000100:00100000:1.0:1789048395.200439:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048395.200492:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 0000000057ee6ef5 going to sleep for 11 seconds 00000100:00100000:0.0:1789048395.200565:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111270656 00000100:00100000:0.0:1789048395.200575:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111270656 00000100:00100000:0.0:1789048395.200639:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789048395.200648:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000937637a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+9:6519:x1875953111270656:12345-0@lo:502: 00000100:00100000:0.0:1789048395.200768:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000937637a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+9:6519:x1875953111270656:12345-0@lo:502: Request processed in 121us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048395.200782:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789048395.200962:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d0b7659 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6519:1875953111270656:0@lo:502: 00000020:01000000:1.0:1789048395.200995:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048395.200999:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048395.201001:0:6519:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1789048395.201005:0:6519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1789048395.201573:0:6473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1789048395.201606:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789048395.201628:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 000000007a2ea262/0x133f221c0877593f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775946 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048395.201643:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 000000007a2ea262/0x133f221c0877593f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775946 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048395.201652:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c335d0800 from 1 10000000:01000000:0.0:1789048395.201655:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789048395.201709:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775993 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048395.201717:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775993 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048395.201727:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775993 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048395.201744:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000059edd48c pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111270784:0@lo:101: 00000100:00100000:0.0:1789048395.201787:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048395.201820:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eda6d212 going to sleep for 11 seconds 00000100:00100000:1.0:1789048395.201990:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111270784 00000100:00100000:1.0:1789048395.201998:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111270784 00000100:00100000:1.0:1789048395.202035:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789048395.202042:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aa6de837 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+9:6473:x1875953111270784:12345-0@lo:101: 00010000:00010000:1.0:1789048395.202054:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048395.202069:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004457dc88/0x133f221c0877599a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775993 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048395.202106:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004457dc88/0x133f221c0877599a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775993 expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048395.202116:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004457dc88/0x133f221c0877599a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775993 expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048395.202125:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004457dc88, rc 0) 00000100:00100000:1.0:1789048395.202186:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aa6de837 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+10:6473:x1875953111270784:12345-0@lo:101: Request processed in 144us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048395.202200:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789048395.202378:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000059edd48c pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111270784:0@lo:101: 00010000:00010000:3.0:1789048395.202393:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775993 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c0877599a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.202402:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775993 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c0877599a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048395.202923:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000196762c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111270912:0@lo:256: 00000100:00100000:3.0:1789048395.202969:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048395.202991:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0f5ab6a going to sleep for 11 seconds 00000100:00100000:1.0:1789048395.203155:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111270912 00000100:00100000:1.0:1789048395.203161:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111270912 00000100:00100000:1.0:1789048395.203201:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789048395.203208:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008a0fddd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+10:6473:x1875953111270912:12345-0@lo:256: 20000000:01000000:1.0:1789048395.203223:0:6492:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789048395.203229:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789048395.203296:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008a0fddd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+10:6473:x1875953111270912:12345-0@lo:256: Request processed in 89us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048395.203303:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789048395.203525:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000196762c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111270912:0@lo:256: 10000000:01000000:3.0:1789048395.204166:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789048395.204374:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775993 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c0877599a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.204386:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c0877599a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048395.205044:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c335d0800 from 1 10000000:01000000:3.0:1789048395.205047:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789048395.205083:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 000000004237203c/0x133f221c087759a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.205090:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 000000004237203c/0x133f221c087759a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.205099:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 000000004237203c/0x133f221c087759a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048395.205117:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000196762c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111271040:0@lo:101: 00000100:00100000:3.0:1789048395.205186:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048395.205238:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0f5ab6a going to sleep for 11 seconds 00000100:00100000:1.0:1789048395.205848:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111271040 00000100:00100000:1.0:1789048395.205859:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111271040 00000100:00100000:1.0:1789048395.205916:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789048395.205925:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a2fc46f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+10:6473:x1875953111271040:12345-0@lo:101: 00010000:00010000:1.0:1789048395.205938:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048395.205953:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ea71b16a/0x133f221c087759a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087759a1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048395.205976:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ea71b16a/0x133f221c087759a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087759a1 expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048395.205998:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ea71b16a/0x133f221c087759a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087759a1 expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048395.206005:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ea71b16a, rc 0) 00000100:00100000:1.0:1789048395.206049:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a2fc46f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+11:6473:x1875953111271040:12345-0@lo:101: Request processed in 125us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048395.206055:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789048395.206170:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000196762c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111271040:0@lo:101: 00010000:00010000:2.0:1789048395.206199:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 000000004237203c/0x133f221c087759a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087759a8 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048395.206210:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 000000004237203c/0x133f221c087759a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087759a8 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048395.206284:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111271168:0@lo:501: 00000100:00100000:2.0:1789048395.206313:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048395.206371:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set 00000000367ad42a going to sleep for 11 seconds 00000100:00100000:3.0:1789048395.206507:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111271168 00000100:00100000:3.0:1789048395.206513:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111271168 00000100:00100000:3.0:1789048395.206537:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789048395.206544:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cf3823c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+11:6473:x1875953111271168:12345-0@lo:501: 00000100:00100000:3.0:1789048395.206702:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cf3823c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+11:6473:x1875953111271168:12345-0@lo:501: Request processed in 159us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048395.206709:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789048395.206869:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111271168:0@lo:501: 00000100:00100000:2.0:1789048395.206899:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111271296:0@lo:503: 00000100:00100000:2.0:1789048395.206944:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048395.206969:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set 00000000367ad42a going to sleep for 11 seconds 00000100:00100000:3.0:1789048395.207016:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111271296 00000100:00100000:3.0:1789048395.207020:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111271296 00000100:00100000:3.0:1789048395.207082:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789048395.207089:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007c571980 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+11:6473:x1875953111271296:12345-0@lo:503: 00000040:00080000:3.0:1789048395.207120:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789048395.207175:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007c571980 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+11:6473:x1875953111271296:12345-0@lo:503: Request processed in 87us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048395.207199:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789048395.207270:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111271296:0@lo:503: 00000040:00080000:1.0:1789048395.208364:0:6523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789048395.208622:0:6473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789048395.208641:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789048395.208716:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 000000004237203c/0x133f221c087759a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087759a8 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048395.208728:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 000000004237203c/0x133f221c087759a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087759a8 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048395.208777:0:6473:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789048395.208780:0:6473:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff959c335d0800 10000000:01000000:2.0:1789048395.208783:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff959c335d0800 10000000:01000000:2.0:1789048395.208787:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789048395.208792:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959c335d0800 from 1 10000000:01000000:2.0:1789048395.208795:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789048395.208829:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c087759af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048395.208836:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c087759af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048395.208848:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c087759af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048395.208871:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111271424:0@lo:101: 00000100:00100000:2.0:1789048395.208931:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048395.208971:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d32e8a0d going to sleep for 11 seconds 00000100:00100000:1.0:1789048395.209027:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111271424 00000100:00100000:1.0:1789048395.209033:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111271424 00000100:00100000:1.0:1789048395.209077:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789048395.209085:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000074a2a0e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+11:6473:x1875953111271424:12345-0@lo:101: 00010000:00010000:1.0:1789048395.209099:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048395.209110:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cffccf82/0x133f221c087759b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087759af expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048395.209131:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cffccf82/0x133f221c087759b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087759af expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048395.209170:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cffccf82/0x133f221c087759b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087759af expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048395.209178:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cffccf82, rc 0) 00000100:00100000:1.0:1789048395.209226:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000074a2a0e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:6473:x1875953111271424:12345-0@lo:101: Request processed in 142us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048395.209232:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789048395.209450:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111271424:0@lo:101: 00010000:00010000:2.0:1789048395.209465:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c087759af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087759b6 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048395.209472:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c087759af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087759b6 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048395.209534:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111271552:0@lo:501: 00000100:00100000:2.0:1789048395.209560:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048395.209590:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d32e8a0d going to sleep for 11 seconds 00000100:00100000:3.0:1789048395.209633:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111271552 00000100:00100000:3.0:1789048395.209639:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111271552 00000100:00100000:3.0:1789048395.209670:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789048395.209676:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bc7020e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:6473:x1875953111271552:12345-0@lo:501: 00000100:00100000:3.0:1789048395.209806:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bc7020e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:6473:x1875953111271552:12345-0@lo:501: Request processed in 130us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048395.209811:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789048395.209874:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111271552:0@lo:501: 00000100:00100000:2.0:1789048395.209902:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111271680:0@lo:503: 00000100:00100000:2.0:1789048395.209939:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048395.209960:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d32e8a0d going to sleep for 11 seconds 00000100:00100000:3.0:1789048395.210002:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111271680 00000100:00100000:3.0:1789048395.210007:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111271680 00000100:00100000:3.0:1789048395.210039:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789048395.210045:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007b9a0e94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:6473:x1875953111271680:12345-0@lo:503: 00000100:00100000:3.0:1789048395.210118:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007b9a0e94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:6473:x1875953111271680:12345-0@lo:503: Request processed in 74us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048395.210126:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789048395.210325:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111271680:0@lo:503: 00000100:00100000:2.0:1789048395.210763:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6524:1875953111271808:0@lo:502: 00000100:00100000:2.0:1789048395.210798:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048395.211516:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set 000000007cbc180f going to sleep for 11 seconds 00000100:00100000:3.0:1789048395.211776:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111271808 00000100:00100000:3.0:1789048395.211785:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111271808 00000100:00100000:2.0:1789048395.213499:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789048395.213519:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d41dfe78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:6524:x1875953111271808:12345-0@lo:502: 00000100:00100000:2.0:1789048395.213721:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d41dfe78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:6524:x1875953111271808:12345-0@lo:502: Request processed in 210us (2923us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048395.213730:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789048395.213837:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6524:1875953111271808:0@lo:502: 00000020:01000004:3.0:1789048395.213901:0:6524:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789048395.213917:0:6524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000033793eeb) 00000020:00000080:3.0:1789048395.213936:0:6524:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789048395.214035:0:6524:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000051288f6b from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789048395.214039:0:6524:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000051288f6b from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789048395.214041:0:6524:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000051288f6b 4 00010000:00080000:3.0:1789048395.214066:0:6524:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005bc3c545@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:3.0:1789048395.215731:0:6524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789048395.215991:0:6524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789048395.216042:0:6524:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789048395.216058:0:6524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x133f221c087759c4 00000100:00080000:3.0:1789048395.216069:0:6524:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789048395.216081:0:6524:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005bc3c545 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048395.216129:0:6524:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f9db09fb x1875953111271936/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048395.216189:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f9db09fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875953111271936:0@lo:38: 00000100:00100000:3.0:1789048395.216256:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789048395.216310:0:6524:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789048395.218637:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111271936 00000100:00100000:0.0:1789048395.218652:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111271936 00000100:00100000:0.0:1789048395.218694:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789048395.218700:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d9d932a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111271936:12345-0@lo:38: 00000100:00100000:0.0:1789048395.218789:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d9d932a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111271936:12345-0@lo:38: Request processed in 88us (2534us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789048395.218805:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789048395.218871:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789048395.218878:0:3619:0:(import.c:65:import_set_state_nolock()) 000000005bc3c545 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789048395.218882:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789048395.218885:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f9db09fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875953111271936:0@lo:38: 00000100:00100000:1.0:1789048395.219648:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d0b7659 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6524:1875953111272064:0@lo:502: 00000100:00100000:1.0:1789048395.219712:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048395.219751:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set 000000005e0cc490 going to sleep for 11 seconds 00000100:00100000:2.0:1789048395.221304:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111272064 00000100:00100000:2.0:1789048395.221318:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111272064 00000100:00100000:2.0:1789048395.221412:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789048395.221421:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ff78bac7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:6524:x1875953111272064:12345-0@lo:502: 00000100:00100000:2.0:1789048395.221574:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ff78bac7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:6524:x1875953111272064:12345-0@lo:502: Request processed in 154us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048395.221582:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789048395.221902:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d0b7659 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6524:1875953111272064:0@lo:502: 00000040:00080000:1.0:1789048395.221953:0:6524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1789048395.223171:0:6473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1789048395.224319:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789048395.224363:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c087759af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087759b6 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.224376:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c087759af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087759b6 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789048395.224428:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789048395.224431:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789048395.224433:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789048395.224434:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789048395.224435:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789048395.224436:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789048395.224437:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789048395.224439:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789048395.224440:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789048395.224441:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789048395.224443:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789048395.224444:0:6473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789048395.224447:0:6473:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1789048395.224450:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789048395.224451:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789048395.224457:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789048395.224458:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789048395.224459:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789048395.224460:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789048395.224461:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789048395.224461:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789048395.224462:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789048395.224463:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789048395.224464:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789048395.224465:0:6473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789048395.224492:0:6473:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789048395.224513:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007849255b pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111272192:0@lo:253: 00000100:00100000:3.0:1789048395.224588:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048395.224630:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set 000000001037cbaf going to sleep for 11 seconds 00000100:00100000:2.0:1789048395.224843:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111272192 00000100:00100000:2.0:1789048395.224853:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111272192 00000100:00100000:2.0:1789048395.224909:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789048395.224919:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c188816b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:6473:x1875953111272192:12345-0@lo:253: 20000000:01000000:2.0:1789048395.224945:0:6490:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789048395.224959:0:6490:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789048395.236387:0:6490:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789048395.236407:0:6490:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789048395.236953:0:6513:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789048395.236960:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789048395.236986:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002939a958/0x133f221c087759cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.237007:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004457dc88/0x133f221c0877599a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775993 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.237013:0:6513:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002939a958/0x133f221c087759cb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.237059:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004457dc88/0x133f221c0877599a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775993 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048395.237073:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004457dc88/0x133f221c0877599a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775993 expref: 12 pid: 6491 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048395.237087:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000077765e54 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875953111272320:0@lo:104: 00000100:00100000:3.0:1789048395.237162:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048395.237226:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 00000000402ef93e going to sleep for 11 seconds 00000100:00100000:1.0:1789048395.237386:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111272320 00000100:00100000:1.0:1789048395.237394:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111272320 00000100:00100000:1.0:1789048395.237444:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789048395.237454:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007bb6eb6f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:6513:x1875953111272320:12345-0@lo:104: 00010000:00010000:1.0:1789048395.237467:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c0877599a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048395.237526:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789048395.237531:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007bb6eb6f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:6513:x1875953111272320:12345-0@lo:104: Request processed in 80us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048395.237538:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789048395.237711:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c188816b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:6473:x1875953111272192:12345-0@lo:253: Request processed in 12794us (13123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048395.237719:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1789048395.237823:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048395.237829:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c0877599a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048395.237842:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000de8afb01 already unused, calling callback (0000000096291af7) 10000000:00010000:0.0:1789048395.237846:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c0877599a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048395.237853:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c0877599a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048395.237860:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c0877599a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048395.237866:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789048395.237899:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775993 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c0877599a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048395.237906:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789048395.237927:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775993 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c0877599a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048395.237934:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775993 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c0877599a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048395.237959:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048395.237961:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048395.237962:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048395.238100:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007849255b pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6473:1875953111272192:0@lo:253: 10000000:01000000:3.0:1789048395.238113:0:6473:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789048395.238116:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789048395.238117:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789048395.238119:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789048395.238120:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789048395.238121:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789048395.238122:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789048395.238124:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789048395.238125:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789048395.238126:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789048395.238128:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789048395.238129:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789048395.238130:0:6473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789048395.238154:0:6473:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789048395.240158:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000fb8b05f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111272448:0@lo:103: 00000100:00100000:2.0:1789048395.240233:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048395.240627:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111272448 00000100:00100000:0.0:1789048395.240650:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111272448 00010000:00010000:0.0:1789048395.240684:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004457dc88/0x133f221c0877599a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775993 expref: 12 pid: 6491 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048395.240724:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789048395.240734:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000b198834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:3621:x1875953111272448:12345-0@lo:103: 00010000:00010000:0.0:1789048395.240748:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048395.240752:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004457dc88/0x133f221c0877599a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775993 expref: 12 pid: 6491 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048395.240763:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004457dc88/0x133f221c0877599a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775993 expref: 12 pid: 6491 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048395.240783:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002939a958/0x133f221c087759cb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048395.240792:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002939a958/0x133f221c087759cb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789048395.240809:0:6481:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003850414s 00010000:00010000:0.0:1789048395.240813:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002939a958/0x133f221c087759cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048395.240819:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002939a958/0x133f221c087759cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048395.240842:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002939a958/0x133f221c087759cb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048395.240848:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002939a958/0x133f221c087759cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048395.240855:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002939a958 already unused, calling callback (0000000072af32a2) 00010000:00010000:0.0:1789048395.240858:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002939a958/0x133f221c087759cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048395.240865:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002939a958/0x133f221c087759cb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048395.240873:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002939a958/0x133f221c087759cb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048395.240884:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048395.240929:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000b198834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:3621:x1875953111272448:12345-0@lo:103: Request processed in 196us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048395.240936:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789048395.240977:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000fb8b05f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111272448:0@lo:103: 00010000:00010000:2.0:1789048395.243582:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004457dc88/0x133f221c0877599a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775993 expref: 11 pid: 6491 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048395.243605:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000077765e54 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875953111272320:0@lo:104: 00010000:00010000:2.0:1789048395.243629:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002939a958/0x133f221c087759cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048395.243651:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002939a958/0x133f221c087759cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048395.243657:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002939a958/0x133f221c087759cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048395.243662:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002939a958/0x133f221c087759cb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789048395.249757:0:6473:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1789048395.249957:0:6473:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789048395.250199:0:6473:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1789048395.250394:0:6473:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789048395.250621:0:6473:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1789048395.250799:0:6473:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1789048395.266910:0:6473:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1789048395.267074:0:6473:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789048395.267787:0:6473:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1789048395.268115:0:6473:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789048395.272722:0:6473:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1789048395.272982:0:6473:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1789048395.275922:0:6473:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1789048395.283069:0:6473:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789048395.283277:0:6529:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789048395.283281:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1789048395.283885:0:6530:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789048395.285674:0:6473:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789048395.285786:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789048395.286550:0:6473:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789048395.286562:0:6473:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789048395.286712:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789048395.287791:0:6473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789048395.293257:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789048395.298500:0:6473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789048395.298626:0:6473:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789048395.298889:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789048395.299106:0:6473:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1789048395.299863:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789048395.300023:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789048395.300189:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789048395.300379:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789048395.300517:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789048395.300656:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789048395.300828:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789048395.300980:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789048395.301120:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789048395.301278:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789048395.301463:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789048395.301643:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789048395.301782:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789048395.301906:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789048395.302037:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789048395.302711:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789048395.303035:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789048395.303948:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789048395.304180:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00000040:00080000:0.0:1789048395.306291:0:6530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789048395.306405:0:6530:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789048395.306409:0:6530:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1789048395.306923:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789048395.307113:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789048395.307468:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789048395.307614:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789048395.307762:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789048395.307897:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789048395.308069:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789048395.308587:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789048395.308733:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789048395.308866:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789048395.309018:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789048395.309302:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789048395.309606:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789048395.309815:0:6473:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1789048395.312555:0:6473:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789048395.312593:0:6473:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb770c1c4f988 00100000:10000000:3.0:1789048395.312601:0:6473:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789048395.313160:0:6473:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789048395.313176:0:6473:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789048395.313266:0:6473:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1789048395.313282:0:6473:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1789048395.314091:0:6473:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789048395.314293:0:6473:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789048395.752967:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048396.765573:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048397.790163:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048398.817028:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048399.839621:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789048400.132053:0:6774:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1789048400.349473:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789048400.349483:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789048400.349486:0:36:0:(import.c:65:import_set_state_nolock()) 000000005bc3c545 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789048400.349504:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005bc3c545 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048400.349527:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000058ef6e02 x1875953111272704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048400.349566:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058ef6e02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875953111272704:0@lo:38: 00000100:00100000:3.0:1789048400.349681:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048400.349866:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007849255b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111272576:0@lo:400: 00000100:00100000:2.0:1789048400.349905:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048400.349969:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111272704 00000100:00100000:2.0:1789048400.349978:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111272704 00000100:00100000:2.0:1789048400.350015:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789048400.350020:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b0614cbf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875953111272704:12345-0@lo:38: 00010000:00080000:2.0:1789048400.350054:0:6499:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:2.0:1789048400.350113:0:6499:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x133f221c087759d2 00000004:00100000:2.0:1789048400.350156:0:6499:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789048400.350277:0:6499:0:(import.c:65:import_set_state_nolock()) 00000000d6784189 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789048400.350329:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b0614cbf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875953111272704:12345-0@lo:38: Request processed in 307us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048400.350368:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789048400.350668:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111272576 00000100:00100000:3.0:1789048400.350674:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111272576 00000100:00100000:3.0:1789048400.350715:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789048400.350722:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000274d7dde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+11:3622:x1875953111272576:12345-0@lo:400: 00000100:00100000:3.0:1789048400.350771:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000274d7dde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+11:3622:x1875953111272576:12345-0@lo:400: Request processed in 51us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048400.350778:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789048400.350827:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007849255b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111272576:0@lo:400: 00010000:00080000:3.0:1789048400.350857:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000058ef6e02 x1875953111272704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789048410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789048400.350871:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789048400.350878:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789048400.350884:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789048400.350886:0:3619:0:(import.c:65:import_set_state_nolock()) 000000005bc3c545 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789048400.350891:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058ef6e02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875953111272704:0@lo:38: 00010000:00010000:1.0:1789048400.869246:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789048401.280284:0:6826:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789048401.280534:0:6826:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789048401.887719:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048402.910096:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789048402.910113:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789048402.910117:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c335d0800 from 3 10000000:01000000:0.0:1789048402.910122:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789048402.910166:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c087759d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048402.910177:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c087759d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048402.910188:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c087759d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048402.910211:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000fb8b05f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111272832:0@lo:101: 00000100:00100000:0.0:1789048402.910306:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048402.910393:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 00000000edc0669b going to sleep for 11 seconds 00000100:00100000:3.0:1789048402.910513:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111272832 00000100:00100000:3.0:1789048402.910521:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111272832 00000100:00100000:3.0:1789048402.910617:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789048402.910625:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dbd71918 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+11:6494:x1875953111272832:12345-0@lo:101: 00010000:00010000:3.0:1789048402.910637:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048402.910649:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003e5e1c9b/0x133f221c087759e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087759d9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048402.910669:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e5e1c9b/0x133f221c087759e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087759d9 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048402.910679:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003e5e1c9b/0x133f221c087759e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087759d9 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048402.910687:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003e5e1c9b, rc 0) 00000100:00100000:3.0:1789048402.910738:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dbd71918 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:6494:x1875953111272832:12345-0@lo:101: Request processed in 114us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048402.910758:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789048402.910786:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000fb8b05f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111272832:0@lo:101: 00010000:00010000:1.0:1789048402.910799:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c087759d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087759e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048402.910807:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c087759d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087759e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048402.910860:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d0b7659 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111272960:0@lo:256: 00000100:00100000:1.0:1789048402.910893:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048402.910919:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 0000000048e9c118 going to sleep for 11 seconds 00000100:00100000:3.0:1789048402.910976:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111272960 00000100:00100000:3.0:1789048402.910981:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111272960 00000100:00100000:3.0:1789048402.911012:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789048402.911018:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005c38ce56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:6494:x1875953111272960:12345-0@lo:256: 20000000:01000000:3.0:1789048402.911031:0:6492:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789048402.911056:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789048402.911060:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789048402.911171:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005c38ce56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:6494:x1875953111272960:12345-0@lo:256: Request processed in 154us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048402.911178:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789048402.911410:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d0b7659 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111272960:0@lo:256: 10000000:01000000:0.0:1789048402.911458:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789048402.911465:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c087759d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087759e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048402.911472:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c087759d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087759e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048403.933476:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789048404.105898:0:6928:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789048404.106107:0:6928:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789048404.960519:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048405.471581:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789048405.471605:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058ef6e02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111273088:0@lo:400: 00000100:00100000:3.0:1789048405.471670:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048405.471876:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789048405.471885:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007849255b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111273216:0@lo:400: 00000100:00100000:1.0:1789048405.471920:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048405.471963:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111273088 00000100:00100000:1.0:1789048405.471971:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111273088 00000100:00100000:1.0:1789048405.472013:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789048405.472020:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d86fb89e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:3622:x1875953111273088:12345-0@lo:400: 00000100:00100000:1.0:1789048405.472083:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d86fb89e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:3622:x1875953111273088:12345-0@lo:400: Request processed in 63us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048405.472090:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789048405.472133:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058ef6e02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111273088:0@lo:400: 00000100:00100000:1.0:1789048405.472167:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111273216 00000100:00100000:1.0:1789048405.472171:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111273216 00000100:00100000:1.0:1789048405.472210:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789048405.472216:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e7021719 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111273216:12345-0@lo:400: 00000100:00100000:1.0:1789048405.472250:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e7021719 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111273216:12345-0@lo:400: Request processed in 35us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048405.472256:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789048405.472284:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007849255b x1875953111273216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048405.472295:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007849255b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111273216:0@lo:400: 00010000:00010000:3.0:1789048405.985084:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048407.014402:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048408.039230:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048409.053485:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048410.085740:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048410.590819:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789048410.590862:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b6a21fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111273344:0@lo:400: 00000100:00100000:1.0:1789048410.590871:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062d1c5c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111273472:0@lo:400: 00000100:00100000:3.0:1789048410.590983:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048410.591153:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048410.591190:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111273344 00000100:00100000:2.0:1789048410.591202:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111273344 00000100:00100000:3.0:1789048410.591304:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111273472 00000100:00100000:3.0:1789048410.591310:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111273472 00000100:00100000:2.0:1789048410.591918:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789048410.591930:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e0cfad24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:3620:x1875953111273344:12345-0@lo:400: 00000100:00100000:2.0:1789048410.592015:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e0cfad24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:3620:x1875953111273344:12345-0@lo:400: Request processed in 88us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048410.592022:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789048410.593427:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789048410.593458:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d94d7e8c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111273472:12345-0@lo:400: 00000100:00100000:3.0:1789048410.593557:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d94d7e8c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111273472:12345-0@lo:400: Request processed in 108us (2412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048410.593565:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789048410.594429:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000062d1c5c2 x1875953111273472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048410.594462:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062d1c5c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111273472:0@lo:400: 00000100:00100000:3.0:1789048410.594464:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b6a21fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111273344:0@lo:400: 00010000:00010000:3.0:1789048411.101455:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048412.129411:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048413.149485:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789048413.782995:0:7426:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789048413.782998:0:7426:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789048413.782999:0:7426:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789048413.783129:0:7426:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000342bd792 00000020:01000004:3.0:1789048413.783143:0:7426:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1789048413.783154:0:7426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789048413.783166:0:7426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000007d16d93f) 00000020:00000080:3.0:1789048413.783179:0:7426:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789048413.864249:0:7426:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1789048413.864585:0:7426:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1789048413.883970:0:7426:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789048413.885505:0:7426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789048413.885517:0:7426:0:(osd_handler.c:8921:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789048413.885530:0:7426:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x133f221c087759ee 00000020:01000004:3.0:1789048413.885536:0:7426:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789048413.885555:0:7426:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789048413.885558:0:7426:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789048413.885564:0:7426:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789048413.885589:0:7426:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789048413.885592:0:7426:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1789048413.912930:0:7426:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789048413.912980:0:7426:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.116@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1789048413.912984:0:7426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789048413.912986:0:7426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789048413.912987:0:7426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789048413.912989:0:7426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789048413.912990:0:7426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789048413.912991:0:7426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789048413.912992:0:7426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789048413.912993:0:7426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789048413.912999:0:7426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789048413.913000:0:7426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789048413.913001:0:7426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789048413.913005:0:7426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1789048413.913175:0:7426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789048413.913177:0:7426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789048413.913178:0:7426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789048413.913179:0:7426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789048413.913179:0:7426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789048413.913180:0:7426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789048413.913181:0:7426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789048413.913182:0:7426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789048413.913183:0:7426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789048413.913183:0:7426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789048413.913184:0:7426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789048413.913212:0:7426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789048413.913229:0:7426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000564db4aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111273600:0@lo:253: 00000100:00100000:3.0:1789048413.913311:0:7426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048413.913615:0:7426:0:(client.c:2716:ptlrpc_set_wait()) set 000000001a8774a1 going to sleep for 11 seconds 00000100:00100000:0.0:1789048413.913668:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111273600 00000100:00100000:0.0:1789048413.913677:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111273600 00000100:00100000:1.0:1789048413.913843:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789048413.913853:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008d809b01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:7426:x1875953111273600:12345-0@lo:253: 20000000:01000000:1.0:1789048413.913884:0:6492:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789048413.913888:0:6492:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1789048413.913893:0:6492:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1789048413.913896:0:6492:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1789048413.913931:0:6492:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1789048413.914211:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789048413.914551:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1789048413.914566:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789048413.914586:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1789048413.914604:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1789048413.914620:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1789048413.914678:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1789048413.914688:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1789048413.914701:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1789048413.914708:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1789048413.914720:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1789048413.914725:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1789048413.914737:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1789048413.914751:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1789048413.914842:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1789048413.914852:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:1.0:1789048413.914865:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1789048413.914871:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789048413.914884:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1789048413.914901:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:1.0:1789048413.914916:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1789048413.914922:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789048413.914935:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1789048413.914950:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1789048413.914977:0:6492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1789048413.915220:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1789048413.915230:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1789048413.915243:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1789048413.915259:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1789048413.915276:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1789048413.915283:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1789048413.915298:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1789048413.915319:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1789048413.915325:0:6492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1789048413.915616:0:6492:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789048413.915623:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1789048413.915914:0:7432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1789048413.916193:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1789048413.916214:0:6492:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.116@tcp for mdt 20000000:01000000:1.0:1789048413.916216:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:1.0:1789048413.916230:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1789048413.916236:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789048413.916248:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1789048413.916253:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:1.0:1789048413.916270:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1789048413.916278:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1789048413.916292:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1789048413.916309:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1789048413.916593:0:6492:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1789048413.916602:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1789048413.916894:0:7433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1789048413.917057:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1789048413.917072:0:6492:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.116@tcp for mdt 20000000:01000000:1.0:1789048413.917074:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:1.0:1789048413.917090:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1789048413.917096:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789048413.917107:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1789048413.917112:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:1.0:1789048413.917124:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1789048413.917130:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1789048413.917143:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1789048413.917159:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1789048413.917176:0:6492:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789048413.917178:0:6492:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789048413.917182:0:6492:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789048413.917224:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789048413.917226:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789048413.917691:0:7434:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789048413.917714:0:7434:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789048413.917729:0:7434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1789048413.917969:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1789048413.917991:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1789048413.918071:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1789048413.918085:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789048413.918087:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789048413.918686:0:7435:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1789048413.918709:0:7435:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1789048413.918724:0:7435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789048413.918880:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1789048413.918902:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1789048413.918916:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1789048413.918926:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789048413.918928:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789048413.919252:0:7436:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789048413.919273:0:7436:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789048413.919289:0:7436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1789048413.919622:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1789048413.919643:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1789048413.919667:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1789048413.919680:0:6492:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789048413.919682:0:6492:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789048413.919694:0:6492:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789048413.919700:0:6492:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789048413.920117:0:7437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1789048413.920236:0:6492:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789048413.929375:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789048413.929404:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008babb0a3/0x133f221c087759f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.929423:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000086fe0175/0x133f221c0877592a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775923 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.929429:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b103cb41/0x133f221c08775946 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c0877593f expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.929435:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cffccf82/0x133f221c087759b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087759af expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.929439:0:6492:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008babb0a3/0x133f221c087759f5 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.929480:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cffccf82/0x133f221c087759b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c087759af expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.929493:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cffccf82/0x133f221c087759b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c087759af expref: 12 pid: 6492 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048413.929506:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a62edeea pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1875953111273728:0@lo:104: 00000100:00100000:1.0:1789048413.929565:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789048413.929618:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b103cb41/0x133f221c08775946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c0877593f expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.929641:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b103cb41/0x133f221c08775946 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c0877593f expref: 12 pid: 6492 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048413.929650:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039f0a24c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1875953111273856:0@lo:104: 00000100:00100000:1.0:1789048413.929671:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789048413.929688:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000086fe0175/0x133f221c0877592a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775923 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.929694:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000086fe0175/0x133f221c0877592a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775923 expref: 12 pid: 6490 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048413.929700:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f0dadc82 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1875953111273984:0@lo:104: 00000100:00100000:1.0:1789048413.929715:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048413.929722:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 000000004f394588 going to sleep for 11 seconds 00000100:00100000:2.0:1789048413.930031:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111273728 00000100:00100000:2.0:1789048413.930040:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111273728 00000100:00100000:2.0:1789048413.930078:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111273856 00000100:00100000:2.0:1789048413.930081:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111273856 00000100:00100000:2.0:1789048413.930090:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111273984 00000100:00100000:2.0:1789048413.930092:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111273984 00000100:00100000:2.0:1789048413.930104:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789048413.930111:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f4429bb0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+5:6492:x1875953111273728:12345-0@lo:104: 00010000:00010000:2.0:1789048413.930123:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c087759af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087759b6 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.930193:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789048413.930198:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f4429bb0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+5:6492:x1875953111273728:12345-0@lo:104: Request processed in 87us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048413.930205:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789048413.930241:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789048413.930247:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000dc53da5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:6492:x1875953111273856:12345-0@lo:104: 00010000:00010000:2.0:1789048413.930254:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: 000000007a2ea262/0x133f221c0877593f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775946 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.930289:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789048413.930294:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000dc53da5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:6492:x1875953111273856:12345-0@lo:104: Request processed in 49us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048413.930299:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789048413.930311:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789048413.930317:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000076e9691b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:6492:x1875953111273984:12345-0@lo:104: 00010000:00010000:2.0:1789048413.930322:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: 000000006029b2a8/0x133f221c08775923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c0877592a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.930498:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789048413.930503:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000076e9691b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:6492:x1875953111273984:12345-0@lo:104: Request processed in 188us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048413.930509:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789048413.930528:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789048413.930533:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c087759af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087759b6 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.930540:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dd126ffe already unused, calling callback (0000000096291af7) 10000000:00010000:2.0:1789048413.930542:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c087759af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c087759b6 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.930550:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c087759af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c087759b6 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048413.930566:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c087759af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c087759b6 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048413.930571:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789048413.930601:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c087759af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087759b6 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.930606:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048413.930623:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c087759af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087759b6 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.930629:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c087759af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087759b6 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.930642:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789048413.930644:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 000000007a2ea262/0x133f221c0877593f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775946 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.930649:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007a2ea262 already unused, calling callback (0000000096291af7) 10000000:00010000:2.0:1789048413.930651:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 000000007a2ea262/0x133f221c0877593f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775946 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.930657:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 000000007a2ea262/0x133f221c0877593f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775946 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048413.930662:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 000000007a2ea262/0x133f221c0877593f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775946 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048413.930667:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789048413.930686:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 000000007a2ea262/0x133f221c0877593f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775946 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.930691:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048413.930706:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 000000007a2ea262/0x133f221c0877593f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775946 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.930711:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 000000007a2ea262/0x133f221c0877593f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775946 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.930720:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048413.930721:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 000000006029b2a8/0x133f221c08775923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c0877592a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.930727:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006029b2a8 already unused, calling callback (0000000096291af7) 10000000:00010000:2.0:1789048413.930729:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 000000006029b2a8/0x133f221c08775923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c0877592a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.930735:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 000000006029b2a8/0x133f221c08775923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c0877592a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048413.930740:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 000000006029b2a8/0x133f221c08775923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c0877592a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048413.930744:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789048413.930755:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 000000006029b2a8/0x133f221c08775923 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c0877592a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.930760:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048413.930764:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 000000006029b2a8/0x133f221c08775923 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c0877592a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.930779:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 000000006029b2a8/0x133f221c08775923 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c0877592a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.930791:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048413.930793:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048413.930794:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048413.930800:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048413.930817:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062d1c5c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111274112:0@lo:103: 00000100:00100000:2.0:1789048413.930848:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048413.930928:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fd91d40d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111274240:0@lo:103: 00000100:00100000:2.0:1789048413.930951:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048413.930981:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789048413.930987:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d8d7a94 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111274368:0@lo:103: 00000100:00100000:1.0:1789048413.931196:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a62edeea pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1875953111273728:0@lo:104: 00000100:00100000:1.0:1789048413.931205:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039f0a24c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1875953111273856:0@lo:104: 00000100:00100000:1.0:1789048413.931211:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f0dadc82 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1875953111273984:0@lo:104: 00010000:00010000:1.0:1789048413.931233:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008babb0a3/0x133f221c087759f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048413.931471:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048413.931519:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111274112 00000100:00100000:2.0:1789048413.931525:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111274112 00010000:00010000:2.0:1789048413.931545:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cffccf82/0x133f221c087759b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087759af expref: 13 pid: 6492 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048413.931561:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111274240 00000100:00100000:2.0:1789048413.931565:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111274240 00010000:00010000:2.0:1789048413.931575:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b103cb41/0x133f221c08775946 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c0877593f expref: 14 pid: 6492 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048413.931585:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111274368 00000100:00100000:2.0:1789048413.931588:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111274368 00010000:00010000:2.0:1789048413.931595:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000086fe0175/0x133f221c0877592a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775923 expref: 15 pid: 6490 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048413.931621:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789048413.931627:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fd9ad097 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:3623:x1875953111274112:12345-0@lo:103: 00010000:00010000:2.0:1789048413.931638:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048413.931642:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cffccf82/0x133f221c087759b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087759af expref: 15 pid: 6492 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.931651:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cffccf82/0x133f221c087759b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c087759af expref: 15 pid: 6492 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.931662:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cffccf82/0x133f221c087759b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c087759af expref: 15 pid: 6492 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.931673:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048413.931714:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fd9ad097 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:3623:x1875953111274112:12345-0@lo:103: Request processed in 88us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048413.931721:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789048413.931736:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789048413.931741:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000843d8293 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+13:3620:x1875953111274240:12345-0@lo:103: 00010000:00010000:2.0:1789048413.931748:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048413.931751:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b103cb41/0x133f221c08775946 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c0877593f expref: 13 pid: 6492 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.931759:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b103cb41/0x133f221c08775946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c0877593f expref: 13 pid: 6492 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.931767:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b103cb41/0x133f221c08775946 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c0877593f expref: 13 pid: 6492 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.931786:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048413.931814:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000843d8293 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:3620:x1875953111274240:12345-0@lo:103: Request processed in 73us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048413.931820:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789048413.931835:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789048413.931840:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a8efc6a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+11:3620:x1875953111274368:12345-0@lo:103: 00010000:00010000:2.0:1789048413.931846:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048413.931849:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000086fe0175/0x133f221c0877592a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775923 expref: 11 pid: 6490 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.931857:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000086fe0175/0x133f221c0877592a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775923 expref: 11 pid: 6490 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.931865:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000086fe0175/0x133f221c0877592a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775923 expref: 11 pid: 6490 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.931875:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008babb0a3/0x133f221c087759f5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.931883:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008babb0a3/0x133f221c087759f5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.931895:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008babb0a3/0x133f221c087759f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.931901:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008babb0a3/0x133f221c087759f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.931907:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008babb0a3/0x133f221c087759f5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.931920:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008babb0a3/0x133f221c087759f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.931925:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008babb0a3 already unused, calling callback (0000000072af32a2) 00010000:00010000:2.0:1789048413.931928:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008babb0a3/0x133f221c087759f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.931934:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008babb0a3/0x133f221c087759f5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.931944:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008babb0a3/0x133f221c087759f5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048413.931953:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048413.931988:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a8efc6a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+10:3620:x1875953111274368:12345-0@lo:103: Request processed in 149us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048413.931994:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789048413.932114:0:6492:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008babb0a3/0x133f221c087759f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.932123:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008babb0a3/0x133f221c087759f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.932128:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008babb0a3/0x133f221c087759f5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789048413.932151:0:6492:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789048413.932229:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062d1c5c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111274112:0@lo:103: 00000100:00100000:3.0:1789048413.932731:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d8d7a94 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111274368:0@lo:103: 00000100:00100000:3.0:1789048413.932741:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fd91d40d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111274240:0@lo:103: 00000100:00100000:1.0:1789048413.944904:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008d809b01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+9:7426:x1875953111273600:12345-0@lo:253: Request processed in 31045us (31586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048413.944921:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789048413.945559:0:7426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000564db4aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111273600:0@lo:253: 10000000:01000000:3.0:1789048413.945577:0:7426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789048413.945580:0:7426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789048413.945582:0:7426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789048413.945584:0:7426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789048413.945585:0:7426:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1789048413.945586:0:7426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789048413.945587:0:7426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789048413.945589:0:7426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789048413.945590:0:7426:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789048413.945591:0:7426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789048413.945592:0:7426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789048413.945621:0:7426:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000342bd792 from lustre-MDT0001 10000000:01000000:3.0:1789048413.945662:0:7426:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1789048413.945666:0:7426:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789048413.945673:0:7426:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff959c394bb380 local copy 10000000:01000000:3.0:1789048413.945677:0:7426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789048413.945717:0:7426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 000000002939a958/0x133f221c087759fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048413.945728:0:7426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.116@tcp lock: 000000002939a958/0x133f221c087759fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048413.945737:0:7426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 000000002939a958/0x133f221c087759fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048413.945754:0:7426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000564db4aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111274496:0@lo:101: 00000100:00100000:3.0:1789048413.945794:0:7426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048413.945839:0:7426:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e716c58 going to sleep for 11 seconds 00000100:00100000:1.0:1789048413.945936:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111274496 00000100:00100000:1.0:1789048413.945943:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111274496 00000100:00100000:1.0:1789048413.946003:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789048413.946022:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003923d64d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+9:7426:x1875953111274496:12345-0@lo:101: 00010000:00010000:1.0:1789048413.946035:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048413.946047:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000689d7d9e/0x133f221c08775a03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087759fc expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.946069:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000689d7d9e/0x133f221c08775a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087759fc expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.946079:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000689d7d9e/0x133f221c08775a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087759fc expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.946086:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000689d7d9e, rc 0) 00000100:00100000:1.0:1789048413.946128:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003923d64d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+10:7426:x1875953111274496:12345-0@lo:101: Request processed in 108us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048413.946134:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789048413.946212:0:7426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000564db4aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111274496:0@lo:101: 00010000:00010000:0.0:1789048413.946237:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 000000002939a958/0x133f221c087759fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x133f221c08775a03 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048413.946245:0:7426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 000000002939a958/0x133f221c087759fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x133f221c08775a03 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048413.946368:0:7426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001c48795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111274624:0@lo:501: 00000100:00100000:0.0:1789048413.946400:0:7426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048413.946418:0:7426:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f1c616eb going to sleep for 11 seconds 00000100:00100000:1.0:1789048413.946678:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111274624 00000100:00100000:1.0:1789048413.946684:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111274624 00000100:00100000:1.0:1789048413.946708:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789048413.946714:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000462b57a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+10:7426:x1875953111274624:12345-0@lo:501: 00000100:00100000:1.0:1789048413.946775:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000462b57a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+10:7426:x1875953111274624:12345-0@lo:501: Request processed in 61us (375us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789048413.946791:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789048413.946874:0:7426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001c48795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111274624:0@lo:501: 10000000:01000000:0.0:1789048413.946887:0:7426:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789048413.946905:0:7426:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789048413.946909:0:7426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 000000002939a958/0x133f221c087759fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x133f221c08775a03 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048413.946916:0:7426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 000000002939a958/0x133f221c087759fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x133f221c08775a03 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048413.946922:0:7426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: 000000002939a958/0x133f221c087759fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x133f221c08775a03 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048413.946946:0:7426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789048413.946984:0:7426:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff959c414c7000 10000000:01000000:0.0:1789048413.946989:0:7426:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789048413.946994:0:7426:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff959c394bb380 10000000:01000000:0.0:1789048413.947013:0:7426:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789048413.947017:0:7426:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff959c394bb380 from 1 10000000:01000000:0.0:1789048413.947020:0:7426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789048413.947036:0:7426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 000000000eac1554/0x133f221c08775a0a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048413.947043:0:7426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 000000000eac1554/0x133f221c08775a0a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048413.947050:0:7426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 000000000eac1554/0x133f221c08775a0a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048413.947064:0:7426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001c48795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111274752:0@lo:101: 00000100:00100000:0.0:1789048413.947093:0:7426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048413.947112:0:7426:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d8a7cbd going to sleep for 11 seconds 00010000:00010000:1.0:1789048413.947211:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048413.947217:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 000000002939a958/0x133f221c087759fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x133f221c08775a03 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.947234:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002939a958 already unused, calling callback (0000000096291af7) 10000000:00010000:1.0:1789048413.947238:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 000000002939a958/0x133f221c087759fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x133f221c08775a03 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.947245:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 000000002939a958/0x133f221c087759fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x133f221c08775a03 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048413.947251:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 000000002939a958/0x133f221c087759fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x133f221c08775a03 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048413.947256:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789048413.947274:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 000000002939a958/0x133f221c087759fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x133f221c08775a03 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.947281:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048413.947305:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 000000002939a958/0x133f221c087759fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x133f221c08775a03 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.947311:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 000000002939a958/0x133f221c087759fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x133f221c08775a03 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.947328:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048413.947330:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048413.947352:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048413.947370:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789048413.947386:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f0dadc82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111274880:0@lo:103: 00000100:00100000:1.0:1789048413.947430:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048413.947466:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111274880 00000100:00100000:1.0:1789048413.947470:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111274880 00000100:00100000:1.0:1789048413.947508:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789048413.947515:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000039f0a24c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+10:3623:x1875953111274880:12345-0@lo:103: 00010000:00010000:1.0:1789048413.947525:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048413.947537:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000689d7d9e/0x133f221c08775a03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c087759fc expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.947551:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048413.947581:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000039f0a24c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+9:3623:x1875953111274880:12345-0@lo:103: Request processed in 66us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048413.947587:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789048413.947613:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f0dadc82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111274880:0@lo:103: 00000100:00100000:1.0:1789048413.947630:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111274752 00000100:00100000:1.0:1789048413.947634:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111274752 00000100:00100000:1.0:1789048413.947652:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789048413.947658:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001e15d02d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+9:7426:x1875953111274752:12345-0@lo:101: 00010000:00010000:1.0:1789048413.947667:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048413.947676:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008babb0a3/0x133f221c08775a11 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775a0a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.947691:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008babb0a3/0x133f221c08775a11 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775a0a expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.947699:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008babb0a3/0x133f221c08775a11 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775a0a expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048413.947715:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008babb0a3, rc 0) 00000100:00100000:1.0:1789048413.947743:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001e15d02d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+10:7426:x1875953111274752:12345-0@lo:101: Request processed in 86us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048413.947749:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789048413.947946:0:7426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001c48795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111274752:0@lo:101: 00010000:00010000:0.0:1789048413.947969:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 000000000eac1554/0x133f221c08775a0a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775a11 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048413.947977:0:7426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 000000000eac1554/0x133f221c08775a0a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775a11 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048413.947992:0:7426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789048413.948016:0:7426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 000000000eac1554/0x133f221c08775a0a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775a11 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048413.948023:0:7426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 000000000eac1554/0x133f221c08775a0a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775a11 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048413.948032:0:7426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff959c414c7000 10000000:01000000:0.0:1789048413.948041:0:7426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789048413.948045:0:7426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff959c414c7000 from 1 10000000:01000000:0.0:1789048413.948047:0:7426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789048413.948063:0:7426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000a4090de4/0x133f221c08775a18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048413.948069:0:7426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 00000000a4090de4/0x133f221c08775a18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048413.948075:0:7426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000a4090de4/0x133f221c08775a18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048413.948087:0:7426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001c48795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111275008:0@lo:101: 00000100:00100000:0.0:1789048413.948113:0:7426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048413.948126:0:7426:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d8a7cbd going to sleep for 11 seconds 00000100:00100000:3.0:1789048413.948265:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111275008 00000100:00100000:3.0:1789048413.948270:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111275008 00000100:00100000:3.0:1789048413.948302:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789048413.948308:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cfcdf42d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+10:7426:x1875953111275008:12345-0@lo:101: 00010000:00010000:3.0:1789048413.948315:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048413.948322:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005aeaa0cd/0x133f221c08775a1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775a18 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048413.948515:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005aeaa0cd/0x133f221c08775a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775a18 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048413.948525:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005aeaa0cd/0x133f221c08775a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775a18 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048413.948544:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005aeaa0cd, rc 0) 00000100:00100000:3.0:1789048413.948581:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cfcdf42d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+11:7426:x1875953111275008:12345-0@lo:101: Request processed in 274us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048413.948587:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789048413.948651:0:7426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001c48795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111275008:0@lo:101: 00010000:00010000:0.0:1789048413.948661:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000a4090de4/0x133f221c08775a18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775a1f expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048413.948668:0:7426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000a4090de4/0x133f221c08775a18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775a1f expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048413.948677:0:7426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789048413.948679:0:7426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 00000000a4090de4/0x133f221c08775a18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775a1f expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048413.948685:0:7426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 00000000a4090de4/0x133f221c08775a18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775a1f expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048413.948691:0:7426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789048413.948698:0:7426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789048413.948702:0:7426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff959c414c7000 10000000:01000000:0.0:1789048413.948704:0:7426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789048413.948707:0:7426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1789048413.948709:0:7426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789048413.948723:0:7426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000f338811d/0x133f221c08775a26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048413.948729:0:7426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 00000000f338811d/0x133f221c08775a26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048413.948735:0:7426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000f338811d/0x133f221c08775a26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048413.948745:0:7426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001c48795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111275136:0@lo:101: 00000100:00100000:0.0:1789048413.948766:0:7426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048413.948793:0:7426:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d8a7cbd going to sleep for 11 seconds 00000100:00100000:3.0:1789048413.948836:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111275136 00000100:00100000:3.0:1789048413.948840:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111275136 00000100:00100000:3.0:1789048413.948867:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789048413.948872:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000002882807 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+11:7426:x1875953111275136:12345-0@lo:101: 00010000:00010000:3.0:1789048413.948879:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048413.948885:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000075821e1f/0x133f221c08775a2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775a26 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048413.948896:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000075821e1f/0x133f221c08775a2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775a26 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048413.948903:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000075821e1f/0x133f221c08775a2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775a26 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048413.948909:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000075821e1f, rc 0) 00000100:00100000:3.0:1789048413.948930:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000002882807 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:7426:x1875953111275136:12345-0@lo:101: Request processed in 59us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048413.948935:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789048413.949002:0:7426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001c48795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111275136:0@lo:101: 00010000:00010000:0.0:1789048413.949074:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000f338811d/0x133f221c08775a26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775a2d expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048413.949081:0:7426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000f338811d/0x133f221c08775a26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775a2d expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048413.949149:0:7426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001c48795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111275264:0@lo:501: 00000100:00100000:0.0:1789048413.949170:0:7426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048413.949189:0:7426:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d8a7cbd going to sleep for 11 seconds 00000100:00100000:1.0:1789048413.949262:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111275264 00000100:00100000:1.0:1789048413.949267:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111275264 00000100:00100000:1.0:1789048413.949287:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789048413.949291:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000077a7152d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:7426:x1875953111275264:12345-0@lo:501: 00000100:00100000:1.0:1789048413.949466:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000077a7152d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:7426:x1875953111275264:12345-0@lo:501: Request processed in 175us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048413.949473:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789048413.949550:0:7426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001c48795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111275264:0@lo:501: 00000100:00100000:0.0:1789048413.949573:0:7426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001c48795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111275392:0@lo:503: 00000100:00100000:0.0:1789048413.949608:0:7426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048413.949624:0:7426:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d8a7cbd going to sleep for 11 seconds 00000100:00100000:3.0:1789048413.949675:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111275392 00000100:00100000:3.0:1789048413.949679:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111275392 00000100:00100000:3.0:1789048413.949704:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789048413.949709:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007d794402 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:7426:x1875953111275392:12345-0@lo:503: 00000100:00100000:3.0:1789048413.949772:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007d794402 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:7426:x1875953111275392:12345-0@lo:503: Request processed in 63us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048413.949782:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789048413.949883:0:7426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001c48795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111275392:0@lo:503: 00000040:00080000:0.0:1789048413.950189:0:7426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789048413.950243:0:7426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001c48795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111275520:0@lo:502: 00000100:00100000:0.0:1789048413.950272:0:7426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048413.950295:0:7426:0:(client.c:2716:ptlrpc_set_wait()) set 00000000efd66911 going to sleep for 11 seconds 00000100:00100000:3.0:1789048413.950459:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111275520 00000100:00100000:3.0:1789048413.950464:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111275520 00000100:00100000:3.0:1789048413.950516:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789048413.950522:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005167a3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:7426:x1875953111275520:12345-0@lo:502: 00000100:00100000:3.0:1789048413.950594:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005167a3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:7426:x1875953111275520:12345-0@lo:502: Request processed in 73us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048413.950601:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789048413.950660:0:7426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001c48795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111275520:0@lo:502: 00000040:00080000:0.0:1789048413.950832:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789048413.950855:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1789048413.950867:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1789048413.950878:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1789048413.950890:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1789048413.950901:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1789048413.950912:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1789048413.950922:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1789048413.950933:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1789048413.950943:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1789048413.950955:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1789048413.950982:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1789048413.950993:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1789048413.951004:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1789048413.951027:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1789048413.951038:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1789048413.951049:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1789048413.951060:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1789048413.951072:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1789048413.951083:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1789048413.951094:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1789048413.951105:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1789048413.951125:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1789048413.951143:0:7426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001c48795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111275648:0@lo:502: 00000100:00100000:0.0:1789048413.951175:0:7426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048413.951644:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111275648 00000100:00100000:1.0:1789048413.951650:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111275648 00000100:00100000:1.0:1789048413.951681:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789048413.951686:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000078d485d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:7426:x1875953111275648:12345-0@lo:502: 00000100:00100000:1.0:1789048413.951768:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000078d485d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:7426:x1875953111275648:12345-0@lo:502: Request processed in 81us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048413.951775:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789048413.952191:0:7426:0:(client.c:2716:ptlrpc_set_wait()) set 00000000efd66911 going to sleep for 11 seconds 00000100:00100000:0.0:1789048413.952211:0:7426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001c48795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111275648:0@lo:502: 00000040:00080000:0.0:1789048413.952271:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1789048413.952282:0:7426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1789048413.952934:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048413.952944:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048413.952945:0:7438:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789048413.952949:0:7438:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1789048413.952951:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789048413.952975:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000a41534b5) 00000020:00000080:0.0:1789048413.952999:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1789048413.953079:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789048413.953157:0:7438:0:(osd_handler.c:8921:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789048413.953163:0:7438:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x133f221c08775a3b 00000020:00000080:0.0:1789048413.953555:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789048413.953561:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048413.953565:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048413.953567:0:7438:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789048413.953570:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048413.953574:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048413.953575:0:7438:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1789048413.953579:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789048413.953587:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000093b4f610) 00000020:00000080:0.0:1789048413.953598:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1789048413.953602:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789048413.953603:0:7438:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1789048413.953606:0:7438:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1789048413.953611:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789048413.953664:0:7438:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000342bd792 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1789048413.953677:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000a3a3e9c1) 00000020:00000080:0.0:1789048413.953685:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1789048413.953747:0:7438:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789048413.953753:0:7438:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x133f221c08775a50 00000020:00000080:0.0:1789048413.953855:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789048413.953863:0:7438:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789048413.953867:0:7438:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x133f221c08775a57 00080000:01000000:0.0:1789048413.953873:0:7438:0:(osd_handler.c:8921:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789048413.953875:0:7438:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x133f221c08775a5e 00080000:10000000:0.0:1789048413.954528:0:7438:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1789048413.954682:0:7438:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1789048414.022933:0:7438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1789048414.023288:0:7438:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1789048414.026119:0:7438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1789048414.026626:0:7438:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789048414.040690:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1789048414.040715:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048414.040723:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048414.040725:0:7438:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789048414.040729:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048414.040735:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048414.040737:0:7438:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789048414.040740:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789048414.040745:0:7438:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:00000080:0.0:1789048414.040773:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789048414.040796:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000000af4ca) 00000020:00000080:0.0:1789048414.040818:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789048414.040824:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789048414.040896:0:7438:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789048414.040902:0:7438:0:(osd_handler.c:8921:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789048414.040908:0:7438:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x133f221c08775a6c 00010000:00080000:0.0:1789048414.040946:0:7438:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005e808c8d@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:0.0:1789048414.049636:0:7438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1789048414.050944:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789048414.050973:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789048414.051019:0:7438:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789048414.051040:0:7438:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x133f221c08775a73 00000100:00080000:3.0:1789048414.051051:0:7438:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789048414.051062:0:7438:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000005e808c8d using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048414.051097:0:7438:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ab64d77f x1875953111275776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789048414.051125:0:7438:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1789048414.051180:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048414.051184:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048414.051186:0:7438:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1789048414.051188:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789048414.051191:0:7438:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789048414.051193:0:7438:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789048414.051194:0:7438:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789048414.051195:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789048414.051197:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048414.051199:0:7438:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789048414.051201:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048414.051204:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048414.051211:0:7438:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1789048414.051216:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789048414.051246:0:7438:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789048414.051257:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048414.051260:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048414.051262:0:7438:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1789048414.051264:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048414.051267:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048414.051268:0:7438:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789048414.051271:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789048414.051272:0:7438:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789048414.051298:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048414.051300:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048414.051302:0:7438:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789048414.051304:0:7438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:0.0:1789048414.051619:0:7426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1789048414.051648:0:7426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789048414.051664:0:7426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 00000000f338811d/0x133f221c08775a26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775a2d expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.051675:0:7426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 00000000f338811d/0x133f221c08775a26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775a2d expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048414.051683:0:7426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c414c7000 from 1 10000000:01000000:0.0:1789048414.051686:0:7426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789048414.051710:0:7426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 000000009b8241d5/0x133f221c08775a7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.051717:0:7426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 000000009b8241d5/0x133f221c08775a7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.051728:0:7426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 000000009b8241d5/0x133f221c08775a7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048414.051746:0:7426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001c48795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111275904:0@lo:101: 00000100:00100000:0.0:1789048414.051812:0:7426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048414.051863:0:7426:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e639c98 going to sleep for 11 seconds 00000100:00100000:2.0:1789048414.052040:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab64d77f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111275776:0@lo:38: 00000100:00100000:2.0:1789048414.052127:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048414.052253:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f9803e68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111276032:0@lo:400: 00000100:00100000:0.0:1789048414.052283:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048414.052477:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111276032 00000100:00100000:2.0:1789048414.052485:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111276032 00000100:00100000:2.0:1789048414.052535:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789048414.052544:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ac43342e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111276032:12345-0@lo:400: 00000100:00100000:2.0:1789048414.052596:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ac43342e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111276032:12345-0@lo:400: Request processed in 52us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048414.052602:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789048414.052686:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f9803e68 x1875953111276032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048414.052699:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f9803e68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111276032:0@lo:400: 00000100:00100000:3.0:1789048414.052808:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111275776 00000100:00100000:3.0:1789048414.052813:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111275776 00000100:00100000:3.0:1789048414.052833:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789048414.052837:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000206735b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875953111275776:12345-0@lo:38: 00010000:00080000:3.0:1789048414.052855:0:6502:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:3.0:1789048414.052884:0:6502:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x133f221c08775a81 00000004:00100000:3.0:1789048414.052899:0:6502:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789048414.052904:0:6502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789048414.053670:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111275904 00000100:00100000:1.0:1789048414.053678:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111275904 00000100:00100000:1.0:1789048414.053718:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789048414.053724:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c60f79a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+12:7426:x1875953111275904:12345-0@lo:101: 00010000:00010000:1.0:1789048414.053737:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048414.053752:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000689d7d9e/0x133f221c08775a88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775a7a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048414.053788:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000689d7d9e/0x133f221c08775a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775a7a expref: 13 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048414.053797:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000689d7d9e/0x133f221c08775a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775a7a expref: 13 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048414.053806:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000689d7d9e, rc 0) 00000100:00100000:1.0:1789048414.053864:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c60f79a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+13:7426:x1875953111275904:12345-0@lo:101: Request processed in 141us (2053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048414.053871:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789048414.054233:0:7426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001c48795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111275904:0@lo:101: 00010000:00010000:2.0:1789048414.054252:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 000000009b8241d5/0x133f221c08775a7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775a88 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048414.054268:0:7426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 000000009b8241d5/0x133f221c08775a7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775a88 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048414.054994:0:7426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111276160:0@lo:256: 00000100:00100000:2.0:1789048414.055055:0:7426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048414.055101:0:7426:0:(client.c:2716:ptlrpc_set_wait()) set 000000004a6eba6c going to sleep for 11 seconds 00000100:00100000:0.0:1789048414.055258:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111276160 00000100:00100000:0.0:1789048414.055265:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111276160 00000100:00100000:0.0:1789048414.055305:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789048414.055313:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000565ab33f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+13:7426:x1875953111276160:12345-0@lo:256: 20000000:01000000:0.0:1789048414.055362:0:6490:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789048414.056037:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789048414.056042:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789048414.056161:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000565ab33f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+13:7426:x1875953111276160:12345-0@lo:256: Request processed in 848us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048414.056169:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789048414.056544:0:7426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111276160:0@lo:256: 10000000:01000000:2.0:1789048414.057165:0:7426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789048414.057185:0:7426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 000000009b8241d5/0x133f221c08775a7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775a88 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048414.057196:0:7426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 000000009b8241d5/0x133f221c08775a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775a88 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048414.057205:0:7426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c414c7000 from 1 10000000:01000000:2.0:1789048414.057207:0:7426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789048414.057235:0:7426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c08775a8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048414.057242:0:7426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c08775a8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048414.057250:0:7426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c08775a8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048414.057266:0:7426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111276288:0@lo:101: 00000100:00100000:2.0:1789048414.057308:0:7426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048414.057513:0:7426:0:(client.c:2716:ptlrpc_set_wait()) set 000000004a6eba6c going to sleep for 11 seconds 00000100:00100000:1.0:1789048414.060636:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111276288 00000100:00100000:1.0:1789048414.060651:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111276288 00000100:00100000:1.0:1789048414.061603:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789048414.061616:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a32b50ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+13:7426:x1875953111276288:12345-0@lo:101: 00010000:00010000:1.0:1789048414.061635:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048414.061652:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d4b899fd/0x133f221c08775a96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775a8f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048414.061689:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d4b899fd/0x133f221c08775a96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775a8f expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048414.061699:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d4b899fd/0x133f221c08775a96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775a8f expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048414.061708:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d4b899fd, rc 0) 00000100:00100000:1.0:1789048414.061778:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a32b50ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:7426:x1875953111276288:12345-0@lo:101: Request processed in 166us (4470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048414.061785:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789048414.061911:0:7426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111276288:0@lo:101: 00010000:00010000:2.0:1789048414.061929:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c08775a8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775a96 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048414.061938:0:7426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c08775a8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775a96 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048414.062068:0:7426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111276416:0@lo:501: 00000100:00100000:2.0:1789048414.062105:0:7426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048414.063295:0:7426:0:(client.c:2716:ptlrpc_set_wait()) set 000000004a6eba6c going to sleep for 11 seconds 00000100:00080000:2.0:1789048414.063688:0:6502:0:(import.c:65:import_set_state_nolock()) 000000007662d4e8 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789048414.063753:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000206735b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1875953111275776:12345-0@lo:38: Request processed in 10913us (11625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048414.063767:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789048414.063809:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789048414.063817:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789048414.063825:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2408010450010a0 00000100:00080000:2.0:1789048414.063831:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789048414.063833:0:3619:0:(import.c:65:import_set_state_nolock()) 000000005e808c8d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789048414.063843:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab64d77f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111275776:0@lo:38: 00000100:00100000:0.0:1789048414.063901:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111276416 00000100:00100000:0.0:1789048414.063908:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111276416 00000100:00100000:0.0:1789048414.063941:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789048414.063947:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000027fee733 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:7426:x1875953111276416:12345-0@lo:501: 00000100:00100000:0.0:1789048414.064183:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000027fee733 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:7426:x1875953111276416:12345-0@lo:501: Request processed in 236us (2079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048414.064190:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789048414.064258:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f4a3ba1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111276544:0@lo:41: 00000100:00100000:0.0:1789048414.064290:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048414.064350:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111276544 00000100:00100000:0.0:1789048414.064365:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111276544 00000100:00100000:0.0:1789048414.064389:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789048414.064394:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002dd860ad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3620:x1875953111276544:12345-0@lo:41: 00000004:00000024:0.0:1789048414.064420:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789048414.064457:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002dd860ad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3620:x1875953111276544:12345-0@lo:41: Request processed in 63us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048414.064463:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789048414.064504:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f4a3ba1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111276544:0@lo:41: 00000100:00100000:2.0:1789048414.064808:0:7426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111276416:0@lo:501: 00000100:00100000:2.0:1789048414.064860:0:7426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111276672:0@lo:503: 00000100:00100000:2.0:1789048414.064901:0:7426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048414.064979:0:7426:0:(client.c:2716:ptlrpc_set_wait()) set 000000004a6eba6c going to sleep for 11 seconds 00000100:00100000:0.0:1789048414.065078:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111276672 00000100:00100000:0.0:1789048414.065084:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111276672 00000100:00100000:0.0:1789048414.065153:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789048414.065159:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000030cab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:7426:x1875953111276672:12345-0@lo:503: 00000040:00080000:0.0:1789048414.065197:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789048414.065249:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000030cab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:7426:x1875953111276672:12345-0@lo:503: Request processed in 91us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048414.065256:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789048414.065315:0:7426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111276672:0@lo:503: 00000040:00080000:2.0:1789048414.065626:0:7426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789048414.065679:0:7426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1789048414.065762:0:7426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789048414.067233:0:7443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1789048414.067649:0:7426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789048414.067682:0:7426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789048414.067738:0:7426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c08775a8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775a96 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.067750:0:7426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c08775a8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775a96 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048414.067806:0:7426:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789048414.067809:0:7426:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff959c414c7000 10000000:01000000:0.0:1789048414.067812:0:7426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff959c414c7000 10000000:01000000:0.0:1789048414.067818:0:7426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789048414.067824:0:7426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959c414c7000 from 1 10000000:01000000:0.0:1789048414.067827:0:7426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789048414.067864:0:7426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000151cd580/0x133f221c08775a9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.067872:0:7426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 00000000151cd580/0x133f221c08775a9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.067882:0:7426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000151cd580/0x133f221c08775a9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048414.067916:0:7426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f4a3ba1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111276800:0@lo:101: 00000100:00100000:0.0:1789048414.067990:0:7426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048414.068121:0:7426:0:(client.c:2716:ptlrpc_set_wait()) set 00000000efd66911 going to sleep for 11 seconds 00000100:00100000:3.0:1789048414.068196:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111276800 00000100:00100000:3.0:1789048414.068203:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111276800 00000100:00100000:3.0:1789048414.068284:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789048414.068294:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000057b0ae32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:7426:x1875953111276800:12345-0@lo:101: 00010000:00010000:3.0:1789048414.068307:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048414.068320:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002939a958/0x133f221c08775aa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775a9d expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048414.068715:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002939a958/0x133f221c08775aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775a9d expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048414.068725:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002939a958/0x133f221c08775aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775a9d expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048414.068732:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002939a958, rc 0) 00000100:00100000:3.0:1789048414.068772:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000057b0ae32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:7426:x1875953111276800:12345-0@lo:101: Request processed in 479us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048414.068778:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789048414.068856:0:7426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f4a3ba1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111276800:0@lo:101: 00010000:00010000:0.0:1789048414.068871:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000151cd580/0x133f221c08775a9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775aa4 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.068879:0:7426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000151cd580/0x133f221c08775a9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775aa4 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048414.068996:0:7426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f4a3ba1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111276928:0@lo:501: 00000100:00100000:0.0:1789048414.069099:0:7426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048414.069253:0:7426:0:(client.c:2716:ptlrpc_set_wait()) set 00000000efd66911 going to sleep for 11 seconds 00000100:00100000:1.0:1789048414.069329:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111276928 00000100:00100000:1.0:1789048414.069348:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111276928 00000100:00100000:2.0:1789048414.069626:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789048414.069634:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c9625ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:7426:x1875953111276928:12345-0@lo:501: 00000100:00100000:2.0:1789048414.069743:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c9625ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:7426:x1875953111276928:12345-0@lo:501: Request processed in 110us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048414.069750:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789048414.069816:0:7426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f4a3ba1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111276928:0@lo:501: 00000100:00100000:0.0:1789048414.069844:0:7426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f4a3ba1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111277056:0@lo:503: 00000100:00100000:0.0:1789048414.069883:0:7426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048414.069972:0:7426:0:(client.c:2716:ptlrpc_set_wait()) set 00000000efd66911 going to sleep for 11 seconds 00000100:00100000:3.0:1789048414.070115:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111277056 00000100:00100000:3.0:1789048414.070121:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111277056 00000100:00100000:3.0:1789048414.070154:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789048414.070161:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f40365df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:7426:x1875953111277056:12345-0@lo:503: 00000100:00100000:3.0:1789048414.070246:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f40365df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:7426:x1875953111277056:12345-0@lo:503: Request processed in 85us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048414.070253:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789048414.070329:0:7426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f4a3ba1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111277056:0@lo:503: 00000040:00080000:0.0:1789048414.070627:0:7426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789048414.070687:0:7426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f4a3ba1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111277184:0@lo:502: 00000100:00100000:0.0:1789048414.070720:0:7426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048414.070738:0:7426:0:(client.c:2716:ptlrpc_set_wait()) set 0000000011895ed7 going to sleep for 11 seconds 00000100:00100000:3.0:1789048414.070890:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111277184 00000100:00100000:3.0:1789048414.070896:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111277184 00000100:00100000:3.0:1789048414.070916:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789048414.070921:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002cadc153 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:7426:x1875953111277184:12345-0@lo:502: 00000100:00100000:3.0:1789048414.071016:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002cadc153 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:7426:x1875953111277184:12345-0@lo:502: Request processed in 83us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048414.071024:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789048414.071165:0:7426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f4a3ba1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111277184:0@lo:502: 00000040:00080000:0.0:1789048414.071326:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789048414.071393:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789048414.071409:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789048414.071424:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789048414.071437:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789048414.071450:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789048414.071476:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789048414.071491:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789048414.071504:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789048414.071516:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789048414.071529:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789048414.071542:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789048414.071555:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789048414.071568:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789048414.071579:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789048414.071593:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789048414.071605:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789048414.071617:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789048414.071629:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789048414.071641:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789048414.071654:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789048414.071667:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789048414.071690:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789048414.071707:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789048414.071719:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789048414.071732:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789048414.071745:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789048414.071759:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1789048414.071780:0:7426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f4a3ba1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111277312:0@lo:502: 00000100:00100000:0.0:1789048414.071819:0:7426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048414.071848:0:7426:0:(client.c:2716:ptlrpc_set_wait()) set 00000000efd66911 going to sleep for 11 seconds 00000100:00100000:3.0:1789048414.072307:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111277312 00000100:00100000:3.0:1789048414.072315:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111277312 00000100:00100000:3.0:1789048414.072427:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789048414.072443:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000083844093 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:7426:x1875953111277312:12345-0@lo:502: 00000100:00100000:3.0:1789048414.072539:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000083844093 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:7426:x1875953111277312:12345-0@lo:502: Request processed in 98us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048414.072546:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789048414.072691:0:7426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f4a3ba1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111277312:0@lo:502: 00000040:00080000:0.0:1789048414.072747:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789048414.072764:0:7426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789048414.073310:0:7444:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789048414.073326:0:7444:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000006dd42181) 00000020:00000080:0.0:1789048414.073378:0:7444:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789048414.073482:0:7444:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000342bd792 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789048414.073486:0:7444:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000342bd792 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789048414.073488:0:7444:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000342bd792 3 00010000:00080000:0.0:1789048414.073513:0:7444:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001006db12@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:0.0:1789048414.077642:0:7444:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1789048414.077917:0:7444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789048414.077970:0:7444:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789048414.077983:0:7444:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x133f221c08775ab2 00000100:00080000:0.0:1789048414.077993:0:7444:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789048414.078077:0:7444:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000001006db12 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048414.078114:0:7444:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f4a3ba1e x1875953111277440/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789048414.078143:0:7444:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789048414.078482:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f4a3ba1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875953111277440:0@lo:38: 00000100:00100000:3.0:1789048414.078546:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1789048414.078778:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1789048414.078825:0:7426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1789048414.078851:0:7426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789048414.078863:0:7426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 00000000151cd580/0x133f221c08775a9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775aa4 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048414.078874:0:7426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 00000000151cd580/0x133f221c08775a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775aa4 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789048414.078919:0:7426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789048414.078921:0:7426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789048414.078923:0:7426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789048414.078924:0:7426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789048414.078925:0:7426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789048414.078927:0:7426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789048414.078928:0:7426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789048414.078929:0:7426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789048414.078931:0:7426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789048414.078932:0:7426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789048414.078934:0:7426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789048414.078937:0:7426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1789048414.078939:0:7426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789048414.078941:0:7426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789048414.078942:0:7426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789048414.078943:0:7426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789048414.078944:0:7426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789048414.078945:0:7426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789048414.078951:0:7426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789048414.078952:0:7426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789048414.078952:0:7426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789048414.078953:0:7426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789048414.078954:0:7426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789048414.078982:0:7426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789048414.078994:0:7426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a89d17b pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111277568:0@lo:253: 00000100:00100000:3.0:1789048414.079313:0:7426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048414.079448:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111277568 00000100:00100000:3.0:1789048414.079456:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111277568 00000100:00100000:3.0:1789048414.079498:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789048414.079505:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b00335aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:7426:x1875953111277568:12345-0@lo:253: 20000000:01000000:3.0:1789048414.079529:0:6492:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789048414.079541:0:6492:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789048414.079944:0:7426:0:(client.c:2716:ptlrpc_set_wait()) set 000000003e3e7089 going to sleep for 11 seconds 40000000:00080000:0.0:1789048414.080523:0:7445:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:2.0:1789048414.080769:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111277440 00000100:00100000:2.0:1789048414.080776:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111277440 00000100:00100000:2.0:1789048414.080813:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789048414.080819:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000070a5c562 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111277440:12345-0@lo:38: 00010000:00080000:2.0:1789048414.080841:0:6497:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:2.0:1789048414.080890:0:6497:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x133f221c08775ab9 00000004:00100000:2.0:1789048414.080904:0:6497:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789048414.080934:0:6497:0:(import.c:65:import_set_state_nolock()) 00000000464438b8 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789048414.081041:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000070a5c562 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875953111277440:12345-0@lo:38: Request processed in 221us (2495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048414.081059:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789048414.081111:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f4a3ba1e x1875953111277440/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789048424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048414.081130:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789048414.081146:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789048414.081153:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789048414.081157:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789048414.081168:0:3619:0:(import.c:65:import_set_state_nolock()) 000000001006db12 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789048414.081173:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f4a3ba1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875953111277440:0@lo:38: 00000001:00100000:3.0:1789048414.082783:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1789048414.092902:0:6492:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789048414.093021:0:6492:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1789048414.095438:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b00335aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:7426:x1875953111277568:12345-0@lo:253: Request processed in 15922us (16115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048414.095454:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789048414.095538:0:7426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a89d17b pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7426:1875953111277568:0@lo:253: 10000000:01000000:2.0:1789048414.095555:0:7426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789048414.095558:0:7426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789048414.095559:0:7426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789048414.095561:0:7426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048414.095562:0:7426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048414.095563:0:7426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048414.095565:0:7426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048414.095566:0:7426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789048414.095567:0:7426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789048414.095568:0:7426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789048414.095569:0:7426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048414.095571:0:7426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789048414.095585:0:7426:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1789048414.099623:0:6513:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789048414.099635:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789048414.099656:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b103cb41/0x133f221c08775ac0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048414.099675:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003e5e1c9b/0x133f221c087759e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087759d9 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048414.099682:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000689d7d9e/0x133f221c08775a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775a7a expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048414.099688:0:6513:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b103cb41/0x133f221c08775ac0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048414.099735:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000689d7d9e/0x133f221c08775a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775a7a expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048414.099769:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000689d7d9e/0x133f221c08775a88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775a7a expref: 14 pid: 6492 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048414.099784:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d31ca9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875953111277696:0@lo:104: 00000100:00100000:3.0:1789048414.099847:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789048414.099908:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003e5e1c9b/0x133f221c087759e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c087759d9 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048414.099915:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003e5e1c9b/0x133f221c087759e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c087759d9 expref: 14 pid: 6490 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048414.099922:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036053ea1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875953111277824:0@lo:104: 00000100:00100000:3.0:1789048414.099939:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048414.099972:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 0000000005e30685 going to sleep for 11 seconds 00000100:00100000:1.0:1789048414.100100:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111277696 00000100:00100000:1.0:1789048414.100109:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111277696 00000100:00100000:1.0:1789048414.100145:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111277824 00000100:00100000:1.0:1789048414.100147:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111277824 00000100:00100000:1.0:1789048414.100161:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789048414.100168:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f944d388 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:6513:x1875953111277696:12345-0@lo:104: 00010000:00010000:1.0:1789048414.100179:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: 000000009b8241d5/0x133f221c08775a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775a88 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048414.100233:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789048414.100237:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f944d388 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:6513:x1875953111277696:12345-0@lo:104: Request processed in 71us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048414.100244:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789048414.100260:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789048414.100265:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000106fc350 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:6513:x1875953111277824:12345-0@lo:104: 00010000:00010000:1.0:1789048414.100271:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c087759d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087759e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048414.100309:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789048414.100313:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000106fc350 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:6513:x1875953111277824:12345-0@lo:104: Request processed in 49us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048414.100318:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789048414.100368:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789048414.100373:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 000000009b8241d5/0x133f221c08775a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775a88 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048414.100380:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009b8241d5 already unused, calling callback (0000000096291af7) 10000000:00010000:1.0:1789048414.100388:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 000000009b8241d5/0x133f221c08775a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775a88 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048414.100396:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 000000009b8241d5/0x133f221c08775a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775a88 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.100396:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1789048414.100402:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 000000009b8241d5/0x133f221c08775a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775a88 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048414.100408:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789048414.100434:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 000000009b8241d5/0x133f221c08775a7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775a88 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048414.100440:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048414.100458:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 000000009b8241d5/0x133f221c08775a7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775a88 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048414.100463:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 000000009b8241d5/0x133f221c08775a7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775a88 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048414.100473:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048414.100474:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048414.100475:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048414.100491:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f0dadc82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111277952:0@lo:103: 00000100:00100000:1.0:1789048414.100519:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048414.100556:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111277952 00000100:00100000:1.0:1789048414.100560:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111277952 00010000:00010000:1.0:1789048414.100575:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000689d7d9e/0x133f221c08775a88 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775a7a expref: 15 pid: 6492 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048414.100604:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789048414.100619:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a62edeea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:3621:x1875953111277952:12345-0@lo:103: 00010000:00010000:1.0:1789048414.100632:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048414.100637:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000689d7d9e/0x133f221c08775a88 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775a7a expref: 15 pid: 6492 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048414.100644:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000689d7d9e/0x133f221c08775a88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775a7a expref: 15 pid: 6492 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048414.100657:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048414.100685:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a62edeea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:3621:x1875953111277952:12345-0@lo:103: Request processed in 68us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048414.100691:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789048414.100724:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f0dadc82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111277952:0@lo:103: 00010000:00010000:1.0:1789048414.100750:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000689d7d9e/0x133f221c08775a88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775a7a expref: 14 pid: 6492 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048414.100760:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d31ca9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875953111277696:0@lo:104: 00000100:00100000:1.0:1789048414.100767:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036053ea1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875953111277824:0@lo:104: 00010000:00010000:1.0:1789048414.100780:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b103cb41/0x133f221c08775ac0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1789048414.101919:0:7426:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00010000:00010000:0.0:1789048414.103572:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048414.103585:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c087759d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087759e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.103597:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000de8afb01 already unused, calling callback (0000000096291af7) 10000000:00010000:0.0:1789048414.103601:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c087759d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c087759e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.103610:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c087759d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c087759e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048414.103628:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c087759d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c087759e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048414.103634:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789048414.103678:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c087759d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087759e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.103686:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789048414.103705:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c087759d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087759e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.103711:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c087759d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087759e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.103729:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048414.103730:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048414.103732:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048414.103749:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dfc3de35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111278080:0@lo:103: 00000100:00100000:0.0:1789048414.103825:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048414.103890:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111278080 00000100:00100000:0.0:1789048414.103897:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111278080 00010000:00010000:0.0:1789048414.103924:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003e5e1c9b/0x133f221c087759e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087759d9 expref: 14 pid: 6490 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1789048414.105316:0:7426:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789048414.105700:0:7426:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789048414.105879:0:7426:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00000100:00100000:0.0:1789048414.106516:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789048414.106536:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000cb266c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:3622:x1875953111278080:12345-0@lo:103: 00010000:00010000:0.0:1789048414.106556:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048414.106564:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003e5e1c9b/0x133f221c087759e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087759d9 expref: 14 pid: 6490 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.106588:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003e5e1c9b/0x133f221c087759e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c087759d9 expref: 14 pid: 6490 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.106605:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003e5e1c9b/0x133f221c087759e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c087759d9 expref: 14 pid: 6490 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.106621:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b103cb41/0x133f221c08775ac0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.106629:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b103cb41/0x133f221c08775ac0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789048414.106645:0:6481:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007010859s 00010000:00010000:0.0:1789048414.106649:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b103cb41/0x133f221c08775ac0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.106654:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b103cb41/0x133f221c08775ac0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.106659:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b103cb41/0x133f221c08775ac0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.106665:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b103cb41/0x133f221c08775ac0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.106670:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b103cb41 already unused, calling callback (0000000072af32a2) 00010000:00010000:0.0:1789048414.106674:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b103cb41/0x133f221c08775ac0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.106680:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b103cb41/0x133f221c08775ac0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.106712:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b103cb41/0x133f221c08775ac0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048414.106724:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048414.106795:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000cb266c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+13:3622:x1875953111278080:12345-0@lo:103: Request processed in 267us (2970us total) trans 0 rc 0/0 00080000:10000000:2.0:1789048414.106990:0:7426:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789048414.107285:0:7426:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:3.0:1789048414.107806:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b103cb41/0x133f221c08775ac0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048414.107817:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b103cb41/0x133f221c08775ac0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048414.107822:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b103cb41/0x133f221c08775ac0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048414.108437:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dfc3de35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111278080:0@lo:103: 00010000:00010000:3.0:1789048414.108468:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048414.108472:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1789048414.108579:0:7426:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789048414.108827:0:7426:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789048414.110293:0:7426:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1789048414.110654:0:7426:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789048414.110866:0:7426:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1789048414.111097:0:7426:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000100:00100000:0.0:1789048414.111398:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:01000000:2.0:1789048414.114038:0:7426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1789048414.114228:0:7450:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789048414.114232:0:7450:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789048414.114936:0:7451:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:1.0:1789048414.114998:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f0dadc82 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7451:1875953111278208:0@lo:700: 00000100:00100000:1.0:1789048414.115076:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048414.115116:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d92a2caf going to sleep for 11 seconds 00000100:00100000:0.0:1789048414.115173:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111278208 00000100:00100000:0.0:1789048414.115181:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111278208 00000100:00100000:0.0:1789048414.115231:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789048414.115239:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000de1832ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7451:x1875953111278208:12345-0@lo:700: 00000040:01000000:2.0:1789048414.115668:0:7426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1789048414.116038:0:7452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7452:1875953111278336:0@lo:1000: 00000100:00100000:2.0:1789048414.116078:0:7452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048414.116115:0:7452:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044434171 going to sleep for 11 seconds 00000100:00100000:0.0:1789048414.116210:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111278336 00000100:00100000:0.0:1789048414.116216:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111278336 00000100:00100000:0.0:1789048414.116254:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789048414.116261:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004901c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7452:x1875953111278336:12345-0@lo:1000: 00000100:00100000:0.0:1789048414.116431:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004901c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7452:x1875953111278336:12345-0@lo:1000: Request processed in 70us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048414.116439:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:01000000:3.0:1789048414.116894:0:7426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1789048414.117033:0:7426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789048414.117679:0:7426:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789048414.117688:0:7426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1789048414.117833:0:7426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789048414.118540:0:7452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7452:1875953111278336:0@lo:1000: 00000040:01000000:2.0:1789048414.118579:0:7452:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1789048414.118615:0:7452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7452:1875953111278464:0@lo:700: 00000100:00100000:2.0:1789048414.118667:0:7452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048414.118710:0:7452:0:(client.c:2716:ptlrpc_set_wait()) set 0000000064b37669 going to sleep for 11 seconds 00000100:00100000:0.0:1789048414.118782:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111278464 00000100:00100000:0.0:1789048414.118789:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111278464 00000100:00100000:0.0:1789048414.118851:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789048414.118860:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e35dbc2d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7452:x1875953111278464:12345-0@lo:700: 00000100:00100000:0.0:1789048414.118912:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e35dbc2d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7452:x1875953111278464:12345-0@lo:700: Request processed in 53us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048414.118919:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789048414.119319:0:7452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7452:1875953111278464:0@lo:700: 00000100:00100000:2.0:1789048414.119462:0:7452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7452:1875953111278592:0@lo:900: 00000100:00100000:2.0:1789048414.119493:0:7452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048414.119514:0:7452:0:(client.c:2716:ptlrpc_set_wait()) set 0000000064b37669 going to sleep for 11 seconds 00000100:00100000:0.0:1789048414.119571:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111278592 00000100:00100000:0.0:1789048414.119576:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111278592 00000100:00100000:0.0:1789048414.119611:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789048414.119618:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003a8f2e92 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7452:x1875953111278592:12345-0@lo:900: 00000100:00100000:0.0:1789048414.119657:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003a8f2e92 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7452:x1875953111278592:12345-0@lo:900: Request processed in 39us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048414.119663:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789048414.119730:0:7452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000210a36ba x1875953111278592/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789048430 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048414.119740:0:7452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7452:1875953111278592:0@lo:900: 00000100:00100000:2.0:1789048414.119803:0:7452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7452:1875953111278720:0@lo:1000: 00000100:00100000:2.0:1789048414.119829:0:7452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048414.119846:0:7452:0:(client.c:2716:ptlrpc_set_wait()) set 00000000785d1252 going to sleep for 11 seconds 00000100:00100000:0.0:1789048414.119923:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111278720 00000100:00100000:0.0:1789048414.119927:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111278720 00000100:00100000:0.0:1789048414.119968:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789048414.119974:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ba929be8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7452:x1875953111278720:12345-0@lo:1000: 00000100:00100000:0.0:1789048414.120026:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ba929be8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7452:x1875953111278720:12345-0@lo:1000: Request processed in 53us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048414.120032:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789048414.120189:0:7452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7452:1875953111278720:0@lo:1000: 00000004:00080000:2.0:1789048414.120228:0:7452:0:(osp_trans.c:1618:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000064b37669 with version 0 00000020:00100000:2.0:1789048414.120242:0:7452:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789048414.120254:0:7452:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000210a36ba x1875953111278976/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789048414.120267:0:7452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7452:1875953111278976:0@lo:1000: 00000100:00100000:2.0:1789048414.120290:0:7452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048414.120308:0:7452:0:(client.c:2716:ptlrpc_set_wait()) set 000000007afa7a5d going to sleep for 11 seconds 00000100:00100000:0.0:1789048414.120586:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111278976 00000100:00100000:0.0:1789048414.120591:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111278976 00000100:00100000:0.0:1789048414.120616:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789048414.120621:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000007aaa588 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7452:x1875953111278976:12345-0@lo:1000: 00000040:00080000:3.0:1789048414.121913:0:7426:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789048414.123329:0:7426:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789048414.123508:0:7426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789048414.123774:0:7426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789048414.124015:0:7426:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789048414.125292:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789048414.125920:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789048414.126160:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 40000000:02000000:0.0:1789048414.126379:0:6504:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:2.0:1789048414.126594:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789048414.126754:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789048414.127545:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1789048414.127698:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789048414.127839:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789048414.128103:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789048414.128466:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789048414.128617:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1789048414.128766:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789048414.129220:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1789048414.129802:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789048414.130040:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789048414.130270:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789048414.130743:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789048414.130999:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789048414.131224:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789048414.131565:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789048414.131758:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789048414.131998:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789048414.132226:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000100:00100000:0.0:1789048414.133785:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000de1832ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7451:x1875953111278208:12345-0@lo:700: Request processed in 18533us (18695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048414.133811:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789048414.134723:0:7451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f0dadc82 x1875953111278208/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789048430 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048414.134742:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f0dadc82 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7451:1875953111278208:0@lo:700: 40000000:02000000:1.0:1789048414.134773:0:7451:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:0.0:1789048414.135371:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00100000:10000000:2.0:1789048414.135698:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789048414.135881:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789048414.136053:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789048414.136174:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00000100:00100000:0.0:1789048414.137390:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000007aaa588 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7452:x1875953111278976:12345-0@lo:1000: Request processed in 16758us (17089us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789048414.137409:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1789048414.138061:0:7452:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1789048414.138071:0:7452:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789048414.138089:0:7452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7452:1875953111278976:0@lo:1000: 00000100:00100000:2.0:1789048414.138189:0:7452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7452:1875953111279104:0@lo:1000: 00000100:00100000:2.0:1789048414.138245:0:7452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048414.138293:0:7452:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044434171 going to sleep for 11 seconds 00000100:00100000:0.0:1789048414.138940:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111279104 00000100:00100000:0.0:1789048414.138964:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111279104 00000100:00100000:0.0:1789048414.139075:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789048414.139086:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000b198834 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7452:x1875953111279104:12345-0@lo:1000: 00000100:00100000:0.0:1789048414.139238:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000b198834 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7452:x1875953111279104:12345-0@lo:1000: Request processed in 154us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048414.139245:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789048414.139532:0:7452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7452:1875953111279104:0@lo:1000: 00000040:00080000:2.0:1789048414.139563:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789048414.139601:0:7452:0:(osp_trans.c:1618:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000064b37669 with version 1 00000004:00080000:2.0:1789048414.139618:0:7441:0:(osp_trans.c:1359:osp_get_next_request()) ou 0000000055a93059 version 1 rpc_version 1 00000020:00100000:2.0:1789048414.139638:0:7441:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789048414.139646:0:7441:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000210a36ba x1875953111279360/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789048414.139664:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7441:1875953111279360:0@lo:1000: 00000100:00100000:2.0:1789048414.139710:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048414.139758:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 000000007afa7a5d going to sleep for 11 seconds 00000100:00100000:2.0:1789048414.139778:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111279360 00000100:00100000:2.0:1789048414.139785:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111279360 00000100:00100000:2.0:1789048414.139834:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789048414.139843:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fd9ad097 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7441:x1875953111279360:12345-0@lo:1000: 00100000:10000000:3.0:1789048414.141484:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789048414.141785:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789048414.144143:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789048414.146541:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00000040:00080000:2.0:1789048414.147928:0:7452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789048414.148722:0:7452:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:0.0:1789048414.152584:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00080000:0.0:1789048414.155660:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1789048414.156219:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fd9ad097 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7441:x1875953111279360:12345-0@lo:1000: Request processed in 16373us (16504us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789048414.156233:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1789048414.156479:0:7441:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789048414.156485:0:7441:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789048414.156504:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000210a36ba pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7441:1875953111279360:0@lo:1000: 00000001:00000004:3.0:1789048414.158239:0:7426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1789048414.172103:0:7426:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789048414.172150:0:7426:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb770c1863988 00100000:10000000:1.0:1789048414.172158:0:7426:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:3.0:1789048414.172278:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:01000004:3.0:1789048414.174490:0:7426:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789048414.174523:0:7426:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789048414.174540:0:7426:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789048414.174556:0:7426:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1789048414.175306:0:7426:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789048414.175609:0:7426:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789048414.186554:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789048414.189596:0:7451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789048414.189685:0:7451:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789048414.189690:0:7451:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1789048415.206102:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048416.221469:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048417.248583:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048418.270299:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789048418.796657:0:7697:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789048419.293713:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048419.294291:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b36ac8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111279616:0@lo:400: 00000100:00100000:1.0:1789048419.294385:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048419.294441:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789048419.294447:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de8715d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111279744:0@lo:400: 00000100:00100000:1.0:1789048419.294477:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048419.294516:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111279616 00000100:00100000:1.0:1789048419.294523:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111279616 00000100:00100000:1.0:1789048419.294562:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789048419.294570:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c41b5937 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111279616:12345-0@lo:400: 00000100:00100000:1.0:1789048419.294622:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c41b5937 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111279616:12345-0@lo:400: Request processed in 53us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048419.294629:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789048419.294669:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000005b36ac8b x1875953111279616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048419.294683:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b36ac8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111279616:0@lo:400: 00000100:00100000:3.0:1789048419.294773:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000038c6531d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111279872:0@lo:400: 00000100:00100000:3.0:1789048419.294802:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048419.294845:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789048419.294851:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f0dadc82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111279488:0@lo:400: 00000100:00100000:3.0:1789048419.294876:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048419.295266:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111279744 00000100:00100000:2.0:1789048419.295272:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111279744 00000100:00100000:2.0:1789048419.295304:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789048419.295311:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f7ac918f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111279744:12345-0@lo:400: 00000100:00100000:2.0:1789048419.295380:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f7ac918f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111279744:12345-0@lo:400: Request processed in 70us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048419.295385:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789048419.295406:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111279872 00000100:00100000:2.0:1789048419.295410:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111279872 00000100:00100000:2.0:1789048419.295434:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789048419.295440:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eea303d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111279872:12345-0@lo:400: 00000100:00100000:2.0:1789048419.295476:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eea303d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111279872:12345-0@lo:400: Request processed in 36us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048419.295481:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789048419.295507:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000038c6531d x1875953111279872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048419.295518:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000038c6531d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111279872:0@lo:400: 00000100:00100000:2.0:1789048419.295568:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de8715d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111279744:0@lo:400: 00000100:00100000:1.0:1789048419.295728:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111279488 00000100:00100000:1.0:1789048419.295733:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111279488 00000100:00100000:1.0:1789048419.295767:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789048419.295773:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e3081746 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+13:3622:x1875953111279488:12345-0@lo:400: 00000100:00100000:1.0:1789048419.295829:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e3081746 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+13:3622:x1875953111279488:12345-0@lo:400: Request processed in 56us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048419.295845:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789048419.296141:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f0dadc82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111279488:0@lo:400: 00000100:00100000:3.0:1789048419.316381:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789048419.316422:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000843d8293 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111280000:0@lo:41: 00000100:00100000:3.0:1789048419.316497:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048419.316571:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111280000 00000100:00100000:3.0:1789048419.316579:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111280000 00000100:00100000:3.0:1789048419.316623:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789048419.316631:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000036053ea1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111280000:12345-0@lo:41: 00000004:00000024:3.0:1789048419.316665:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1789048419.316713:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000036053ea1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111280000:12345-0@lo:41: Request processed in 83us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048419.316720:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789048419.316765:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000843d8293 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111280000:0@lo:41: 00000020:00000004:1.0:1789048419.777556:0:7749:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789048419.777747:0:7749:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789048420.329398:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789048420.829487:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789048420.829495:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c414c7000 from 4 10000000:01000000:1.0:1789048420.829500:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789048420.829547:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 000000004457dc88/0x133f221c08775ac7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048420.829560:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 000000004457dc88/0x133f221c08775ac7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048420.829569:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 000000004457dc88/0x133f221c08775ac7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048420.829591:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b36ac8b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111280128:0@lo:101: 00000100:00100000:1.0:1789048420.829662:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048420.829748:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c698a69b going to sleep for 11 seconds 00000100:00100000:2.0:1789048420.830809:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111280128 00000100:00100000:2.0:1789048420.830818:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111280128 00000100:00100000:2.0:1789048420.830871:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789048420.830877:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c5077f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+13:6494:x1875953111280128:12345-0@lo:101: 00010000:00010000:2.0:1789048420.830898:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048420.830914:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e22ab527/0x133f221c08775ace lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775ac7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048420.830944:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e22ab527/0x133f221c08775ace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775ac7 expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048420.830955:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e22ab527/0x133f221c08775ace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775ac7 expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048420.830963:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e22ab527, rc 0) 00000100:00100000:2.0:1789048420.831032:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c5077f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:6494:x1875953111280128:12345-0@lo:101: Request processed in 155us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048420.831039:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789048420.831151:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b36ac8b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111280128:0@lo:101: 00010000:00010000:3.0:1789048420.831176:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 000000004457dc88/0x133f221c08775ac7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775ace expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048420.831184:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 000000004457dc88/0x133f221c08775ac7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775ace expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048420.831329:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d31ca9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111280256:0@lo:256: 00000100:00100000:2.0:1789048420.833120:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048420.833229:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d65bed88 going to sleep for 11 seconds 00000100:00100000:1.0:1789048420.835955:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111280256 00000100:00100000:1.0:1789048420.835971:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111280256 00000100:00100000:1.0:1789048420.836095:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789048420.836105:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d736da61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:6494:x1875953111280256:12345-0@lo:256: 20000000:01000000:1.0:1789048420.836131:0:6490:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789048420.836154:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789048420.836157:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789048420.836287:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d736da61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:6494:x1875953111280256:12345-0@lo:256: Request processed in 184us (3168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048420.836295:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789048420.836350:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d31ca9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111280256:0@lo:256: 10000000:01000000:0.0:1789048420.836406:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789048420.836414:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 000000004457dc88/0x133f221c08775ac7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775ace expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048420.836437:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 000000004457dc88/0x133f221c08775ac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775ace expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048420.836448:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789048420.836450:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959c335d0800 from 21 10000000:01000000:0.0:1789048420.836453:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789048420.836481:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 000000004210f746/0x133f221c08775ad5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048420.836488:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 000000004210f746/0x133f221c08775ad5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048420.836502:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 000000004210f746/0x133f221c08775ad5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048420.836522:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e825e7d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111280384:0@lo:101: 00000100:00100000:0.0:1789048420.836557:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048420.836579:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da9665f3 going to sleep for 11 seconds 00000100:00100000:3.0:1789048420.836670:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111280384 00000100:00100000:3.0:1789048420.836674:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111280384 00000100:00100000:2.0:1789048420.836746:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789048420.836753:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001572bff7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:6494:x1875953111280384:12345-0@lo:101: 00010000:00010000:2.0:1789048420.836762:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048420.836774:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000010e829d6/0x133f221c08775adc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775ad5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048420.836793:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000010e829d6/0x133f221c08775adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775ad5 expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048420.836810:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000010e829d6/0x133f221c08775adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775ad5 expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048420.836819:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000010e829d6, rc 0) 00000100:00100000:2.0:1789048420.836857:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001572bff7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:6494:x1875953111280384:12345-0@lo:101: Request processed in 105us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048420.836863:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789048420.837005:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e825e7d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111280384:0@lo:101: 00010000:00010000:0.0:1789048420.837017:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 000000004210f746/0x133f221c08775ad5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775adc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048420.837025:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 000000004210f746/0x133f221c08775ad5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775adc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048420.837085:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e825e7d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111280512:0@lo:501: 00000100:00100000:0.0:1789048420.837103:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048420.837119:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da9665f3 going to sleep for 11 seconds 00000100:00100000:1.0:1789048420.837141:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111280512 00000100:00100000:1.0:1789048420.837146:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111280512 00000100:00100000:1.0:1789048420.837174:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789048420.837180:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c87fc148 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:6494:x1875953111280512:12345-0@lo:501: 00000100:00100000:1.0:1789048420.837288:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c87fc148 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:6494:x1875953111280512:12345-0@lo:501: Request processed in 108us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048420.837295:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789048420.837323:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e825e7d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111280512:0@lo:501: 00000100:00100000:0.0:1789048420.837370:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e825e7d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111280640:0@lo:503: 00000100:00100000:0.0:1789048420.837406:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048420.837441:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da9665f3 going to sleep for 11 seconds 00000100:00100000:3.0:1789048420.837520:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111280640 00000100:00100000:3.0:1789048420.837524:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111280640 00000100:00100000:3.0:1789048420.837547:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789048420.837553:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003b0566b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:6494:x1875953111280640:12345-0@lo:503: 00000100:00100000:3.0:1789048420.837632:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003b0566b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:6494:x1875953111280640:12345-0@lo:503: Request processed in 80us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048420.837643:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789048420.837702:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e825e7d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111280640:0@lo:503: 00000100:00100000:0.0:1789048420.838210:0:7801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e825e7d5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7801:1875953111280768:0@lo:502: 00000100:00100000:0.0:1789048420.838313:0:7801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048420.838362:0:7801:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c53091d9 going to sleep for 11 seconds 00000100:00100000:1.0:1789048420.838417:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111280768 00000100:00100000:1.0:1789048420.838422:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111280768 00000100:00100000:1.0:1789048420.838926:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789048420.838934:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000125520a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:7801:x1875953111280768:12345-0@lo:502: 00000100:00100000:1.0:1789048420.839031:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000125520a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:7801:x1875953111280768:12345-0@lo:502: Request processed in 98us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048420.839036:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789048420.839316:0:7801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e825e7d5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7801:1875953111280768:0@lo:502: 00000100:00100000:0.0:1789048420.839386:0:7801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e825e7d5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7801:1875953111280896:0@lo:502: 00000100:00100000:0.0:1789048420.839420:0:7801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048420.840224:0:7801:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c53091d9 going to sleep for 11 seconds 00000100:00100000:3.0:1789048420.840282:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111280896 00000100:00100000:3.0:1789048420.840289:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111280896 00000100:00100000:3.0:1789048420.840322:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789048420.840328:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000bde0fd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:7801:x1875953111280896:12345-0@lo:502: 00000100:00100000:3.0:1789048420.840462:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000bde0fd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:7801:x1875953111280896:12345-0@lo:502: Request processed in 135us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048420.840469:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789048420.841088:0:7801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e825e7d5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7801:1875953111280896:0@lo:502: 00000040:00080000:0.0:1789048420.841120:0:7801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1789048420.842529:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1789048420.842562:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789048420.842572:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 000000004210f746/0x133f221c08775ad5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775adc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048420.842585:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 000000004210f746/0x133f221c08775ad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775adc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048420.842595:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789048420.842597:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c335d0800 from 4 10000000:01000000:2.0:1789048420.842600:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789048420.842639:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000120d4bd3/0x133f221c08775ae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048420.842647:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 00000000120d4bd3/0x133f221c08775ae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048420.842656:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000120d4bd3/0x133f221c08775ae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048420.842676:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a8efc6a0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111281024:0@lo:101: 00000100:00100000:2.0:1789048420.842761:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048420.842806:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c73bf8be going to sleep for 11 seconds 00000100:00100000:3.0:1789048420.844196:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111281024 00000100:00100000:3.0:1789048420.844209:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111281024 00000100:00100000:3.0:1789048420.844281:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789048420.844290:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bcae75ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:6494:x1875953111281024:12345-0@lo:101: 00010000:00010000:3.0:1789048420.844305:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048420.844320:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b103cb41/0x133f221c08775aea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775ae3 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048420.844381:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b103cb41/0x133f221c08775aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775ae3 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048420.844391:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b103cb41/0x133f221c08775aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775ae3 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048420.844400:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b103cb41, rc 0) 00000100:00100000:3.0:1789048420.844481:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bcae75ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:6494:x1875953111281024:12345-0@lo:101: Request processed in 192us (1720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048420.844488:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789048420.844738:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a8efc6a0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111281024:0@lo:101: 00010000:00010000:0.0:1789048420.844755:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000120d4bd3/0x133f221c08775ae3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775aea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048420.844764:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000120d4bd3/0x133f221c08775ae3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775aea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048420.844822:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e825e7d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111281152:0@lo:256: 00000100:00100000:0.0:1789048420.844859:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048420.844906:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c53091d9 going to sleep for 11 seconds 00000100:00100000:1.0:1789048420.845028:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111281152 00000100:00100000:1.0:1789048420.845034:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111281152 00000100:00100000:1.0:1789048420.845068:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789048420.845074:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000013cff9bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:6494:x1875953111281152:12345-0@lo:256: 20000000:01000000:1.0:1789048420.845088:0:6490:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789048420.845105:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789048420.845108:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789048420.845526:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000013cff9bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:6494:x1875953111281152:12345-0@lo:256: Request processed in 452us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048420.845531:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789048420.846600:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e825e7d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111281152:0@lo:256: 10000000:01000000:0.0:1789048420.846657:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789048420.846664:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 00000000120d4bd3/0x133f221c08775ae3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775aea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048420.846675:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 00000000120d4bd3/0x133f221c08775ae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775aea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048420.846684:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789048420.846687:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789048420.846689:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789048420.846726:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 000000002d5ad33b/0x133f221c08775af1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048420.846742:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 000000002d5ad33b/0x133f221c08775af1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048420.846751:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 000000002d5ad33b/0x133f221c08775af1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048420.846766:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e825e7d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111281280:0@lo:101: 00000100:00100000:0.0:1789048420.846805:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048420.846943:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c53091d9 going to sleep for 11 seconds 00000100:00100000:2.0:1789048420.848110:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111281280 00000100:00100000:2.0:1789048420.848120:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111281280 00000100:00100000:2.0:1789048420.848174:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789048420.848181:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000042305bf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:6494:x1875953111281280:12345-0@lo:101: 00010000:00010000:2.0:1789048420.854001:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048420.854028:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e75555b4/0x133f221c08775af8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775af1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048420.854060:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e75555b4/0x133f221c08775af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775af1 expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048420.854071:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e75555b4/0x133f221c08775af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775af1 expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048420.854080:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e75555b4, rc 0) 00000100:00100000:2.0:1789048420.854163:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000042305bf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111281280:12345-0@lo:101: Request processed in 5981us (7357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048420.854171:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789048420.854625:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e825e7d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111281280:0@lo:101: 00010000:00010000:0.0:1789048420.854642:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 000000002d5ad33b/0x133f221c08775af1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775af8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048420.854651:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 000000002d5ad33b/0x133f221c08775af1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775af8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048420.854736:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e825e7d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111281408:0@lo:501: 00000100:00100000:0.0:1789048420.854776:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048420.854821:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c53091d9 going to sleep for 11 seconds 00000100:00100000:1.0:1789048420.854864:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111281408 00000100:00100000:1.0:1789048420.854872:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111281408 00000100:00100000:1.0:1789048420.854929:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789048420.854937:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000096e06c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111281408:12345-0@lo:501: 00000100:00100000:1.0:1789048420.855092:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000096e06c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111281408:12345-0@lo:501: Request processed in 155us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048420.855100:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789048420.855238:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e825e7d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111281408:0@lo:501: 00000100:00100000:0.0:1789048420.855263:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e825e7d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111281536:0@lo:503: 00000100:00100000:0.0:1789048420.855301:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048420.855326:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c53091d9 going to sleep for 11 seconds 00000100:00100000:3.0:1789048420.855421:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111281536 00000100:00100000:3.0:1789048420.855426:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111281536 00000100:00100000:3.0:1789048420.855466:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789048420.855473:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003b43c162 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111281536:12345-0@lo:503: 00000100:00100000:3.0:1789048420.855553:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003b43c162 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111281536:12345-0@lo:503: Request processed in 81us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048420.855560:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789048420.855638:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e825e7d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111281536:0@lo:503: 00000100:00100000:0.0:1789048420.856020:0:7802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e825e7d5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7802:1875953111281664:0@lo:502: 00000100:00100000:0.0:1789048420.856060:0:7802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048420.856091:0:7802:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da9665f3 going to sleep for 11 seconds 00000100:00100000:3.0:1789048420.856197:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111281664 00000100:00100000:3.0:1789048420.856201:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111281664 00000100:00100000:3.0:1789048420.856229:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789048420.856236:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a0e9f4fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:7802:x1875953111281664:12345-0@lo:502: 00000100:00100000:3.0:1789048420.856310:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a0e9f4fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:7802:x1875953111281664:12345-0@lo:502: Request processed in 76us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048420.856317:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789048420.856382:0:7802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e825e7d5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7802:1875953111281664:0@lo:502: 00000020:01000000:3.0:1789048420.856404:0:7802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048420.856414:0:7802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048420.856417:0:7802:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789048420.856422:0:7802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789048420.856425:0:7802:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:00000080:3.0:1789048420.856449:0:7802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789048420.856472:0:7802:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000000e9f734e) 00000020:00000080:3.0:1789048420.856492:0:7802:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1789048420.856499:0:7802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789048420.856637:0:7802:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789048420.856642:0:7802:0:(osd_handler.c:8921:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789048420.856650:0:7802:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c08775b06 00010000:00080000:3.0:1789048420.856679:0:7802:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004a980209@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1789048420.867231:0:7802:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1789048420.869097:0:7802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789048420.869112:0:7802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789048420.869156:0:7802:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789048420.869180:0:7802:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x133f221c08775b0d 00000100:00080000:0.0:1789048420.869190:0:7802:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789048420.869200:0:7802:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000004a980209 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048420.869235:0:7802:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000162d9c19 x1875953111281792/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789048420.869261:0:7802:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:0.0:1789048420.869369:0:7802:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1789048420.869567:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000162d9c19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111281792:0@lo:38: 00000100:00100000:2.0:1789048420.869636:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048420.869806:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce658bc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111282048:0@lo:400: 00000100:00100000:1.0:1789048420.869835:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048420.869855:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789048420.869860:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000080a46d86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111281920:0@lo:400: 00000100:00100000:1.0:1789048420.869883:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048420.869953:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b36ac8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111282176:0@lo:400: 00000100:00100000:1.0:1789048420.869976:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048420.870016:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111281792 00000100:00100000:1.0:1789048420.870023:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111281792 00000100:00100000:1.0:1789048420.870045:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111282048 00000100:00100000:1.0:1789048420.870047:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111282048 00000100:00100000:1.0:1789048420.870069:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789048420.870076:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f9803e68 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875953111281792:12345-0@lo:38: 00010000:00080000:1.0:1789048420.870101:0:6502:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:1.0:1789048420.870135:0:6502:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x133f221c08775b14 00000004:00100000:1.0:1789048420.870148:0:6502:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789048420.870154:0:6502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1789048420.870326:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111281920 00000100:00100000:2.0:1789048420.870357:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111281920 00000100:00100000:2.0:1789048420.870394:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111282176 00000100:00100000:2.0:1789048420.870397:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111282176 00000100:00100000:2.0:1789048420.870410:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789048420.870416:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000de8715d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111281920:12345-0@lo:400: 00000100:00100000:2.0:1789048420.870464:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000de8715d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111281920:12345-0@lo:400: Request processed in 48us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048420.870480:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789048420.870497:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789048420.870502:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000038c6531d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111282176:12345-0@lo:400: 00000100:00100000:2.0:1789048420.870535:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000038c6531d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111282176:12345-0@lo:400: Request processed in 33us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048420.870540:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789048420.870575:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000080a46d86 x1875953111281920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048420.870588:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000080a46d86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111281920:0@lo:400: 00010000:00080000:2.0:1789048420.870613:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000005b36ac8b x1875953111282176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048420.870621:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b36ac8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111282176:0@lo:400: 00000100:00080000:2.0:1789048420.879683:0:7805:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000fd91d40d x1875953111282304/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048420.879699:0:7805:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c73bf8be going to sleep for 0 seconds 00000020:01000000:0.0:1789048420.879819:0:7802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048420.879826:0:7802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048420.879828:0:7802:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1789048420.879832:0:7802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048420.879836:0:7802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048420.879837:0:7802:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789048420.879840:0:7802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789048420.879841:0:7802:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789048420.879863:0:7802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050d8286c pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7802:1875953111282432:0@lo:502: 00000100:00100000:0.0:1789048420.880096:0:7802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048420.880145:0:7802:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b0c9d31 going to sleep for 11 seconds 00000100:00100000:2.0:1789048420.880905:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111282432 00000100:00100000:2.0:1789048420.880914:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111282432 00000100:00100000:2.0:1789048420.881027:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789048420.881036:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000017458e51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:7802:x1875953111282432:12345-0@lo:502: 00000100:00100000:2.0:1789048420.881219:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000017458e51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:7802:x1875953111282432:12345-0@lo:502: Request processed in 184us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048420.881227:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1789048420.887269:0:6502:0:(import.c:65:import_set_state_nolock()) 000000002e4a0f2e : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789048420.887410:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f9803e68 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1875953111281792:12345-0@lo:38: Request processed in 17331us (17773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048420.887427:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789048420.887460:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789048420.887470:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f0dadc82 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111282048:12345-0@lo:400: 00000100:00100000:3.0:1789048420.887518:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f0dadc82 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111282048:12345-0@lo:400: Request processed in 51us (17683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048420.887523:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789048420.887670:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce658bc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111282048:0@lo:400: 00000100:00100000:2.0:1789048420.887750:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789048420.887758:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789048420.887766:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2408010450010a0 00000100:00080000:2.0:1789048420.887778:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789048420.887781:0:3619:0:(import.c:65:import_set_state_nolock()) 000000004a980209 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789048420.887800:0:3619:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c73bf8be): req@00000000fd91d40d x1875953111282304/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048420.887819:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000162d9c19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111281792:0@lo:38: 00000100:00100000:0.0:1789048420.887929:0:7805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048420.887975:0:7805:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c73bf8be going to sleep for 11 seconds 00000100:00100000:2.0:1789048420.888068:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111282304 00000100:00100000:2.0:1789048420.888076:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111282304 00000100:00100000:2.0:1789048420.888115:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789048420.888121:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000caaa7eb0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7805:x1875953111282304:12345-0@lo:1000: 00000100:00100000:2.0:1789048420.888181:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000caaa7eb0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7805:x1875953111282304:12345-0@lo:1000: Request processed in 60us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048420.888188:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789048420.888260:0:7805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fd91d40d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7805:1875953111282304:0@lo:1000: 00000040:01000000:0.0:1789048420.888288:0:7805:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789048420.888361:0:7805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af391f16 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7805:1875953111282560:0@lo:1000: 00000100:00100000:0.0:1789048420.888392:0:7805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048420.888402:0:7805:0:(client.c:2716:ptlrpc_set_wait()) set 000000005ea8aafe going to sleep for 11 seconds 00000100:00100000:2.0:1789048420.888456:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111282560 00000100:00100000:2.0:1789048420.888460:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111282560 00000100:00100000:2.0:1789048420.888490:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789048420.888495:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008855e944 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7805:x1875953111282560:12345-0@lo:1000: 00000100:00100000:2.0:1789048420.888582:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008855e944 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7805:x1875953111282560:12345-0@lo:1000: Request processed in 87us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048420.888588:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789048420.889089:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789048420.892793:0:7805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af391f16 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7805:1875953111282560:0@lo:1000: 00000100:00100000:0.0:1789048420.892898:0:7805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af391f16 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7805:1875953111282816:0@lo:700: 00000100:00100000:0.0:1789048420.892968:0:7805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048420.893018:0:7805:0:(client.c:2716:ptlrpc_set_wait()) set 00000000608e43cf going to sleep for 11 seconds 00000100:00100000:1.0:1789048420.893166:0:7802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050d8286c pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:7802:1875953111282432:0@lo:502: 00000100:00100000:3.0:1789048420.893321:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111282816 00000100:00100000:3.0:1789048420.893328:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111282816 00000100:00100000:3.0:1789048420.893419:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789048420.893427:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000022c06b5a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7805:x1875953111282816:12345-0@lo:700: 00000100:00100000:3.0:1789048420.893485:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000022c06b5a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7805:x1875953111282816:12345-0@lo:700: Request processed in 59us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048420.893492:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789048420.893594:0:7805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af391f16 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7805:1875953111282816:0@lo:700: 00000100:00100000:0.0:1789048420.893770:0:7805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af391f16 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7805:1875953111282944:0@lo:1000: 00000100:00100000:0.0:1789048420.893799:0:7805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048420.893824:0:7805:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c218406c going to sleep for 11 seconds 00000100:00100000:3.0:1789048420.894051:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111282944 00000100:00100000:3.0:1789048420.894056:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111282944 00000100:00100000:3.0:1789048420.894090:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789048420.894097:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c10166cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7805:x1875953111282944:12345-0@lo:1000: 00000100:00100000:3.0:1789048420.894167:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c10166cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7805:x1875953111282944:12345-0@lo:1000: Request processed in 70us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048420.894173:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789048420.894247:0:7805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af391f16 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7805:1875953111282944:0@lo:1000: 00000004:00080000:1.0:1789048420.894288:0:7805:0:(osp_trans.c:1618:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000608e43cf with version 0 00000020:00100000:1.0:1789048420.894303:0:7805:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789048420.894317:0:7805:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000039f0a24c x1875953111283200/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789048420.894351:0:7805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039f0a24c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7805:1875953111283200:0@lo:1000: 00000100:00100000:1.0:1789048420.894381:0:7805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048420.894404:0:7805:0:(client.c:2716:ptlrpc_set_wait()) set 000000005ca19676 going to sleep for 11 seconds 00000100:00100000:0.0:1789048420.894483:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111283200 00000100:00100000:0.0:1789048420.894488:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111283200 00000100:00100000:0.0:1789048420.894508:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789048420.894513:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a62edeea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7805:x1875953111283200:12345-0@lo:1000: 00000020:01000000:3.0:1789048420.899698:0:7802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048420.899713:0:7802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048420.899715:0:7802:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789048420.899721:0:7802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1789048420.899907:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789048420.899927:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789048420.899936:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 000000002d5ad33b/0x133f221c08775af1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775af8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048420.899958:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 000000002d5ad33b/0x133f221c08775af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775af8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048420.899969:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789048420.899972:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff959c394bb380 from 1 10000000:01000000:0.0:1789048420.899974:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789048420.900009:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775b1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048420.900026:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775b1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048420.900036:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775b1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048420.900058:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000df0d7553 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111283328:0@lo:101: 00000100:00100000:0.0:1789048420.900124:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048420.900167:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f730c062 going to sleep for 11 seconds 00000100:00100000:1.0:1789048420.900323:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111283328 00000100:00100000:1.0:1789048420.900355:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111283328 00000100:00100000:1.0:1789048420.900404:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789048420.900412:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d0acc45d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111283328:12345-0@lo:101: 00010000:00010000:1.0:1789048420.900427:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048420.900439:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000689d7d9e/0x133f221c08775b22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775b1b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048420.900461:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000689d7d9e/0x133f221c08775b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775b1b expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048420.900471:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000689d7d9e/0x133f221c08775b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775b1b expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048420.900479:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000689d7d9e, rc 0) 00000100:00100000:1.0:1789048420.900520:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d0acc45d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111283328:12345-0@lo:101: Request processed in 109us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048420.900527:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789048420.900878:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000df0d7553 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111283328:0@lo:101: 00010000:00010000:0.0:1789048420.900908:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775b1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775b22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048420.900918:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775b1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775b22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048420.900998:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000df0d7553 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111283456:0@lo:501: 00000100:00100000:0.0:1789048420.901035:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048420.901062:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f730c062 going to sleep for 11 seconds 00000100:00100000:0.0:1789048420.901080:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111283456 00000100:00100000:0.0:1789048420.901084:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111283456 00000100:00100000:0.0:1789048420.901119:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789048420.901127:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003b1cc61e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111283456:12345-0@lo:501: 00000100:00100000:0.0:1789048420.901270:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003b1cc61e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111283456:12345-0@lo:501: Request processed in 145us (235us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789048420.901277:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000001:00080000:1.0:1789048420.901470:0:7428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1789048420.901477:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789048420.901646:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a89d17b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111282688:0@lo:41: 00000100:00100000:2.0:1789048420.901681:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048420.901707:0:6503:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789048420.901715:0:6503:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1789048420.902210:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a62edeea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7805:x1875953111283200:12345-0@lo:1000: Request processed in 7695us (7827us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789048420.902218:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789048420.902233:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111282688 00000100:00100000:0.0:1789048420.902238:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111282688 00000100:00100000:0.0:1789048420.902258:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789048420.902263:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006d8d7a94 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111282688:12345-0@lo:41: 00000004:00000024:0.0:1789048420.902288:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789048420.902329:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006d8d7a94 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111282688:12345-0@lo:41: Request processed in 65us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048420.902361:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789048420.902401:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789048420.902412:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a89d17b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111282688:0@lo:41: 00000004:00080000:1.0:1789048420.902631:0:7805:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1789048420.902646:0:7805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039f0a24c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7805:1875953111283200:0@lo:1000: 00000100:00100000:1.0:1789048420.902728:0:7805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039f0a24c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7805:1875953111283584:0@lo:1000: 00000100:00100000:1.0:1789048420.902764:0:7805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048420.902780:0:7805:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c698a69b going to sleep for 11 seconds 00000100:00100000:0.0:1789048420.902897:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111283584 00000100:00100000:0.0:1789048420.902903:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111283584 00000100:00100000:0.0:1789048420.902927:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789048420.902932:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000d0b7659 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7805:x1875953111283584:12345-0@lo:1000: 00000100:00100000:0.0:1789048420.903005:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000d0b7659 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7805:x1875953111283584:12345-0@lo:1000: Request processed in 73us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048420.903012:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789048420.903236:0:7805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039f0a24c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7805:1875953111283584:0@lo:1000: 00000040:00080000:1.0:1789048420.903253:0:7805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1789048420.903281:0:7805:0:(osp_trans.c:1618:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000db276070 with version 1 00000004:00080000:2.0:1789048420.904115:0:7803:0:(osp_trans.c:1359:osp_get_next_request()) ou 000000001e51cdc3 version 1 rpc_version 1 00000020:00100000:2.0:1789048420.904141:0:7803:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789048420.904148:0:7803:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000062d1c5c2 x1875953111283840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789048420.904172:0:7803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062d1c5c2 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7803:1875953111283840:0@lo:1000: 00000100:00100000:2.0:1789048420.904209:0:7803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048420.904234:0:7803:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a6feb996 going to sleep for 11 seconds 00000040:00080000:1.0:1789048420.905820:0:7805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789048420.905913:0:7805:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789048420.905919:0:7805:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:0.0:1789048420.906278:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111283840 00000100:00100000:0.0:1789048420.906287:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111283840 00000100:00100000:0.0:1789048420.906364:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789048420.906373:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008b6a21fe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7803:x1875953111283840:12345-0@lo:1000: 00000100:00100000:3.0:1789048420.908249:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000df0d7553 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111283456:0@lo:501: 10000000:01000000:2.0:1789048420.908389:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789048420.908399:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775b1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775b22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048420.908409:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 00000000de8afb01/0x133f221c08775b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775b22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789048420.915773:0:7428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1789048420.916104:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008b6a21fe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7803:x1875953111283840:12345-0@lo:1000: Request processed in 9728us (11889us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789048420.916117:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:3.0:1789048420.916237:0:7803:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1789048420.916242:0:7803:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789048420.916268:0:7803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062d1c5c2 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7803:1875953111283840:0@lo:1000: 00010000:00010000:0.0:1789048421.341577:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048422.368609:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789048423.017029:0:7857:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789048423.017319:0:7857:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789048423.391655:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048424.428266:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048424.428440:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cdc3783d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111283968:0@lo:41: 00000100:00100000:1.0:1789048424.428513:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048424.428623:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111283968 00000100:00100000:0.0:1789048424.428644:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111283968 00000100:00100000:0.0:1789048424.428694:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789048424.428702:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000039f0a24c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111283968:12345-0@lo:41: 00000004:00000024:0.0:1789048424.428734:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789048424.428780:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000039f0a24c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111283968:12345-0@lo:41: Request processed in 79us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048424.428787:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789048424.428830:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cdc3783d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111283968:0@lo:41: 00000020:00000080:1.0:1789048424.472989:0:7905:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7d95bba0 20000000:00000080:1.0:1789048424.473007:0:7905:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff959c3eb67800 uarg=0000000000000000 20000000:01000000:1.0:1789048424.473046:0:7905:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789048424.473053:0:7905:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789048424.473057:0:7905:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789048424.473128:0:7905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1789048424.473139:0:7905:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789048424.483321:0:7905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789048424.483606:0:7905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789048424.483638:0:7905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789048424.483651:0:7905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789048424.483664:0:7905:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789048424.483682:0:7905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008a90d962/0x133f221c08775b29 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048424.483700:0:7905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ea71b16a/0x133f221c087759a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087759a1 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048424.483707:0:7905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d4b899fd/0x133f221c08775a96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775a8f expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048424.483713:0:7905:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008a90d962/0x133f221c08775b29 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048424.483747:0:7905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d4b899fd/0x133f221c08775a96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775a8f expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048424.483758:0:7905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d4b899fd/0x133f221c08775a96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775a8f expref: 17 pid: 6491 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048424.483784:0:7905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cdc3783d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7905:1875953111284096:0@lo:104: 00000100:00100000:0.0:1789048424.483850:0:7905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789048424.484249:0:7905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ea71b16a/0x133f221c087759a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c087759a1 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048424.484258:0:7905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ea71b16a/0x133f221c087759a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c087759a1 expref: 17 pid: 6492 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048424.484266:0:7905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f092d818 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7905:1875953111284224:0@lo:104: 00000100:00100000:0.0:1789048424.484288:0:7905:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c9eee4ee going to sleep for 11 seconds 00000100:00100000:1.0:1789048424.484544:0:6480:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789048424.484565:0:6480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048424.484580:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111284096 00000100:00100000:1.0:1789048424.484586:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111284096 00000100:00100000:1.0:1789048424.484719:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111284224 00000100:00100000:1.0:1789048424.484724:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111284224 00000100:00100000:1.0:1789048424.484740:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789048424.484746:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c8cdb186 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:7905:x1875953111284096:12345-0@lo:104: 00010000:00010000:1.0:1789048424.484758:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c08775a8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775a96 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.484834:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789048424.484840:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c8cdb186 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:7905:x1875953111284096:12345-0@lo:104: Request processed in 95us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048424.484847:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789048424.485090:0:7905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cdc3783d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7905:1875953111284096:0@lo:104: 00000100:00100000:1.0:1789048424.485167:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789048424.485174:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f682c0c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:7905:x1875953111284224:12345-0@lo:104: 00010000:00010000:1.0:1789048424.485181:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: 000000004237203c/0x133f221c087759a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087759a8 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.485228:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789048424.485232:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f682c0c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:7905:x1875953111284224:12345-0@lo:104: Request processed in 60us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048424.485238:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1789048424.485259:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789048424.485264:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c08775a8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775a96 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.485270:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dd126ffe already unused, calling callback (0000000096291af7) 10000000:00010000:1.0:1789048424.485273:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c08775a8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775a96 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.485280:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c08775a8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775a96 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048424.485286:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c08775a8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775a96 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048424.485291:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789048424.485324:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c08775a8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775a96 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048424.486246:0:7905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f092d818 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7905:1875953111284224:0@lo:104: 00010000:00010000:2.0:1789048424.486269:0:7905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008a90d962/0x133f221c08775b29 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.486360:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048424.486382:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c08775a8f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775a96 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.486389:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c08775a8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775a96 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.486401:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048424.486404:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 000000004237203c/0x133f221c087759a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087759a8 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.486409:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004237203c already unused, calling callback (0000000096291af7) 10000000:00010000:1.0:1789048424.486411:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 000000004237203c/0x133f221c087759a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c087759a8 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.486418:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 000000004237203c/0x133f221c087759a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c087759a8 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048424.486424:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 000000004237203c/0x133f221c087759a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c087759a8 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048424.486429:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789048424.486452:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 000000004237203c/0x133f221c087759a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087759a8 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.486457:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048424.486468:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 000000004237203c/0x133f221c087759a1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087759a8 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.486486:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 000000004237203c/0x133f221c087759a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087759a8 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.486499:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048424.486501:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048424.486503:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048424.486510:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789048424.486524:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f4429bb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111284352:0@lo:103: 00000100:00100000:1.0:1789048424.486568:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048424.486610:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000dc53da5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111284480:0@lo:103: 00000100:00100000:1.0:1789048424.486634:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048424.486663:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111284352 00000100:00100000:1.0:1789048424.486669:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111284352 00010000:00010000:1.0:1789048424.486692:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d4b899fd/0x133f221c08775a96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775a8f expref: 18 pid: 6491 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048424.486713:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111284480 00000100:00100000:1.0:1789048424.486716:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111284480 00010000:00010000:1.0:1789048424.486729:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ea71b16a/0x133f221c087759a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087759a1 expref: 19 pid: 6492 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048424.486741:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789048424.486747:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000076e9691b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:3620:x1875953111284352:12345-0@lo:103: 00010000:00010000:1.0:1789048424.486758:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048424.486763:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d4b899fd/0x133f221c08775a96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775a8f expref: 19 pid: 6491 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.486771:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d4b899fd/0x133f221c08775a96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775a8f expref: 19 pid: 6491 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.486791:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d4b899fd/0x133f221c08775a96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775a8f expref: 19 pid: 6491 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.486802:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048424.486832:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000076e9691b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:3620:x1875953111284352:12345-0@lo:103: Request processed in 85us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048424.486839:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789048424.486867:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789048424.486882:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ce658bc7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:3622:x1875953111284480:12345-0@lo:103: 00010000:00010000:1.0:1789048424.486891:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048424.486894:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ea71b16a/0x133f221c087759a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087759a1 expref: 17 pid: 6492 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.486902:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ea71b16a/0x133f221c087759a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c087759a1 expref: 17 pid: 6492 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.486921:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ea71b16a/0x133f221c087759a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c087759a1 expref: 17 pid: 6492 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.486933:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008a90d962/0x133f221c08775b29 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.486941:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008a90d962/0x133f221c08775b29 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.486954:0:6482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008a90d962/0x133f221c08775b29 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.486960:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008a90d962/0x133f221c08775b29 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.486972:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008a90d962/0x133f221c08775b29 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.486977:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008a90d962/0x133f221c08775b29 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.486982:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008a90d962 already unused, calling callback (0000000072af32a2) 00010000:00010000:1.0:1789048424.486985:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008a90d962/0x133f221c08775b29 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.486992:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008a90d962/0x133f221c08775b29 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.487002:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008a90d962/0x133f221c08775b29 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048424.487012:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048424.487040:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ce658bc7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:3622:x1875953111284480:12345-0@lo:103: Request processed in 167us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048424.487046:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789048424.487077:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000dc53da5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111284480:0@lo:103: 00000100:00100000:1.0:1789048424.487097:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f4429bb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111284352:0@lo:103: 00010000:00010000:2.0:1789048424.487184:0:7905:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008a90d962/0x133f221c08775b29 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048424.487191:0:7905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008a90d962/0x133f221c08775b29 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048424.487197:0:7905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008a90d962/0x133f221c08775b29 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048424.488607:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048425.437617:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048425.953504:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f092d818 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111284608:0@lo:400: 00000100:00100000:3.0:1789048425.953577:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048425.953645:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050d8286c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111285120:0@lo:400: 00000100:00100000:3.0:1789048425.953670:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048425.953706:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789048425.953712:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af391f16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111284992:0@lo:400: 00000100:00100000:3.0:1789048425.953734:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048425.953760:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000df0d7553 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111284864:0@lo:400: 00000100:00100000:3.0:1789048425.953782:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048425.953800:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789048425.953804:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cdc3783d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111284736:0@lo:400: 00000100:00100000:3.0:1789048425.953822:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048425.953836:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab64d77f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111285248:0@lo:41: 00000100:00100000:3.0:1789048425.953869:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048425.953906:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111284992 00000100:00100000:3.0:1789048425.953915:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111284992 00000100:00100000:3.0:1789048425.953957:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111284736 00000100:00100000:3.0:1789048425.953960:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111284736 00000100:00100000:3.0:1789048425.953974:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789048425.953981:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007849255b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111284992:12345-0@lo:400: 00000100:00100000:3.0:1789048425.954038:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007849255b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111284992:12345-0@lo:400: Request processed in 57us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048425.954046:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789048425.954063:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789048425.954068:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000077765e54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111284736:12345-0@lo:400: 00000100:00100000:3.0:1789048425.954113:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000077765e54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111284736:12345-0@lo:400: Request processed in 45us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048425.954119:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789048425.954137:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111285120 00000100:00100000:3.0:1789048425.954141:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111285120 00000100:00100000:3.0:1789048425.954157:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111284864 00000100:00100000:3.0:1789048425.954160:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111284864 00000100:00100000:3.0:1789048425.954169:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111285248 00000100:00100000:3.0:1789048425.954183:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111285248 00000100:00100000:3.0:1789048425.954197:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789048425.954202:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000564db4aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111285120:12345-0@lo:400: 00000100:00100000:3.0:1789048425.954237:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000564db4aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111285120:12345-0@lo:400: Request processed in 35us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048425.954242:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789048425.954254:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789048425.954260:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000058ef6e02 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111284864:12345-0@lo:400: 00000100:00100000:3.0:1789048425.954282:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000058ef6e02 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111284864:12345-0@lo:400: Request processed in 24us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048425.954287:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789048425.954296:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789048425.954300:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f9db09fb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111285248:12345-0@lo:41: 00000004:00000024:3.0:1789048425.954321:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789048425.954388:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f9db09fb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111285248:12345-0@lo:41: Request processed in 88us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048425.954394:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789048425.954431:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000cdc3783d x1875953111284736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048425.954455:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cdc3783d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111284736:0@lo:400: 00000100:00100000:3.0:1789048425.954472:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab64d77f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111285248:0@lo:41: 00000100:00100000:3.0:1789048425.954480:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000df0d7553 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111284864:0@lo:400: 00010000:00080000:3.0:1789048425.954508:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000af391f16 x1875953111284992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048425.954518:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af391f16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111284992:0@lo:400: 00000100:00100000:3.0:1789048425.954525:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050d8286c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111285120:0@lo:400: 00000100:00100000:0.0:1789048425.956772:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111284608 00000100:00100000:0.0:1789048425.956790:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111284608 00000100:00100000:0.0:1789048425.956868:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789048425.956877:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e28c6402 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:3623:x1875953111284608:12345-0@lo:400: 00000100:00100000:0.0:1789048425.956983:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e28c6402 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:3623:x1875953111284608:12345-0@lo:400: Request processed in 108us (3407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048425.956991:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789048425.957515:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f092d818 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111284608:0@lo:400: 00010000:00010000:1.0:1789048426.483278:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048427.486569:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789048428.282639:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789048428.282660:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c414c7000 from 1 10000000:01000000:2.0:1789048428.282665:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789048428.282709:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c08775b30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048428.282721:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c08775b30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048428.282731:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c08775b30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048428.282755:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111285376:0@lo:101: 00000100:00100000:2.0:1789048428.282833:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048428.282897:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036ccd572 going to sleep for 11 seconds 00000100:00100000:3.0:1789048428.284774:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111285376 00000100:00100000:3.0:1789048428.284786:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111285376 00000100:00100000:3.0:1789048428.284852:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789048428.284861:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c0ba5cbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:6494:x1875953111285376:12345-0@lo:101: 00010000:00010000:3.0:1789048428.284888:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048428.284906:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006029b2a8/0x133f221c08775b37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775b30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048428.284932:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006029b2a8/0x133f221c08775b37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775b30 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048428.284941:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006029b2a8/0x133f221c08775b37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775b30 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048428.284949:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006029b2a8, rc 0) 00000100:00100000:3.0:1789048428.285013:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c0ba5cbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111285376:12345-0@lo:101: Request processed in 154us (2196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048428.285020:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789048428.285206:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111285376:0@lo:101: 00010000:00010000:2.0:1789048428.285222:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c08775b30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775b37 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048428.285230:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000dd126ffe/0x133f221c08775b30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775b37 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048428.285294:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111285504:0@lo:501: 00000100:00100000:2.0:1789048428.285363:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048428.285396:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036ccd572 going to sleep for 11 seconds 00000100:00100000:3.0:1789048428.285583:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111285504 00000100:00100000:3.0:1789048428.285588:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111285504 00000100:00100000:3.0:1789048428.285611:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789048428.285616:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e7dffc1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111285504:12345-0@lo:501: 00000100:00100000:3.0:1789048428.285739:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e7dffc1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111285504:12345-0@lo:501: Request processed in 123us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048428.285746:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789048428.290841:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111285504:0@lo:501: 00000100:00100000:2.0:1789048428.290921:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111285632:0@lo:503: 00000100:00100000:2.0:1789048428.291014:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048428.291049:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036ccd572 going to sleep for 11 seconds 00000100:00100000:3.0:1789048428.291177:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111285632 00000100:00100000:3.0:1789048428.291184:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111285632 00000100:00100000:3.0:1789048428.291235:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789048428.291243:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000061add1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111285632:12345-0@lo:503: 00000100:00100000:3.0:1789048428.291372:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000061add1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111285632:12345-0@lo:503: Request processed in 129us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048428.291380:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789048428.294795:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111285632:0@lo:503: 00000100:00100000:2.0:1789048428.295041:0:8028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8028:1875953111285760:0@lo:502: 00000100:00100000:2.0:1789048428.295111:0:8028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048428.295143:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111285760 00000100:00100000:2.0:1789048428.295160:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111285760 00000100:00100000:2.0:1789048428.295207:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789048428.295216:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5d18f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:8028:x1875953111285760:12345-0@lo:502: 00000100:00100000:2.0:1789048428.295320:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5d18f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:8028:x1875953111285760:12345-0@lo:502: Request processed in 105us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048428.295327:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789048428.295394:0:8028:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068b29029 going to sleep for 11 seconds 00000100:00100000:2.0:1789048428.295407:0:8028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086864082 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8028:1875953111285760:0@lo:502: 00000020:01000000:2.0:1789048428.295426:0:8028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789048428.295434:0:8028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048428.295436:0:8028:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789048428.295444:0:8028:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959c414c7000 00000020:00000080:2.0:1789048428.295447:0:8028:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789048428.295482:0:8028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8028:1875953111285888:0@lo:502: 00000100:00100000:2.0:1789048428.295512:0:8028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048428.295531:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111285888 00000100:00100000:2.0:1789048428.295534:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111285888 00000100:00100000:2.0:1789048428.295556:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789048428.295562:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:8028:x1875953111285888:12345-0@lo:502: 00000100:00100000:2.0:1789048428.295618:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:8028:x1875953111285888:12345-0@lo:502: Request processed in 56us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048428.295629:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789048428.296220:0:8028:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41497300 going to sleep for 11 seconds 00000100:00100000:2.0:1789048428.296236:0:8028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8028:1875953111285888:0@lo:502: 00000020:01000000:2.0:1789048428.296255:0:8028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789048428.296260:0:8028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048428.296262:0:8028:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789048428.296266:0:8028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789048428.296313:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789048428.296349:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789048428.296358:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837800/0x133f221c08775b30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775b37 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048428.296368:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c02837800/0x133f221c08775b30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775b37 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048428.296378:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789048428.296380:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c335d0800 from 1 10000000:01000000:2.0:1789048428.296383:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789048428.296405:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775b3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048428.296413:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775b3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048428.296421:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775b3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048428.296433:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111286016:0@lo:101: 00000100:00100000:2.0:1789048428.296463:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048428.296493:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41497300 going to sleep for 11 seconds 00000100:00100000:3.0:1789048428.299890:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111286016 00000100:00100000:3.0:1789048428.299906:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111286016 00000100:00100000:3.0:1789048428.299963:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789048428.299974:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111286016:12345-0@lo:101: 00010000:00010000:3.0:1789048428.299990:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048428.300008:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c0147be00/0x133f221c08775b45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775b3e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048428.300036:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c0147be00/0x133f221c08775b45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775b3e expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048428.300063:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c0147be00/0x133f221c08775b45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775b3e expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048428.300073:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c0147be00, rc 0) 00000100:00100000:3.0:1789048428.300161:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111286016:12345-0@lo:101: Request processed in 189us (3696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048428.300168:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789048428.302148:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111286016:0@lo:101: 00010000:00010000:0.0:1789048428.302176:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775b3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775b45 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048428.302190:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775b3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775b45 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048428.302292:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111286144:0@lo:501: 00000100:00100000:0.0:1789048428.302378:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048428.302422:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb69780 going to sleep for 11 seconds 00000100:00100000:2.0:1789048428.303910:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111286144 00000100:00100000:2.0:1789048428.303923:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111286144 00000100:00100000:2.0:1789048428.303986:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789048428.303996:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111286144:12345-0@lo:501: 00000100:00100000:2.0:1789048428.304181:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111286144:12345-0@lo:501: Request processed in 187us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048428.304189:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789048428.304906:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111286144:0@lo:501: 00000100:00100000:1.0:1789048428.304956:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111286272:0@lo:503: 00000100:00100000:1.0:1789048428.305007:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048428.305038:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c4153e300 going to sleep for 11 seconds 00000100:00100000:0.0:1789048428.305106:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111286272 00000100:00100000:0.0:1789048428.305112:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111286272 00000100:00100000:0.0:1789048428.305151:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789048428.305159:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111286272:12345-0@lo:503: 00000100:00100000:0.0:1789048428.305238:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111286272:12345-0@lo:503: Request processed in 79us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048428.305244:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789048428.306682:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111286272:0@lo:503: 00000100:00100000:1.0:1789048428.307613:0:8029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b611180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8029:1875953111286400:0@lo:502: 00000100:00100000:1.0:1789048428.307677:0:8029:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048428.307709:0:8029:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c4153ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1789048428.307754:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111286400 00000100:00100000:0.0:1789048428.307760:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111286400 00000100:00100000:0.0:1789048428.307807:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789048428.307815:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:8029:x1875953111286400:12345-0@lo:502: 00000100:00100000:0.0:1789048428.307936:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:8029:x1875953111286400:12345-0@lo:502: Request processed in 121us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048428.307943:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789048428.308042:0:8029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b611180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8029:1875953111286400:0@lo:502: 00000020:01000000:1.0:1789048428.308065:0:8029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048428.308074:0:8029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048428.308077:0:8029:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789048428.308085:0:8029:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959c335d0800 00000020:00000080:1.0:1789048428.308087:0:8029:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789048428.308107:0:8029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b611180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8029:1875953111286528:0@lo:502: 00000100:00100000:1.0:1789048428.308139:0:8029:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048428.308162:0:8029:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c4153ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789048428.308200:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111286528 00000100:00100000:2.0:1789048428.308205:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111286528 00000100:00100000:2.0:1789048428.308235:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789048428.308243:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:8029:x1875953111286528:12345-0@lo:502: 00000100:00100000:2.0:1789048428.308315:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:8029:x1875953111286528:12345-0@lo:502: Request processed in 73us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048428.308323:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789048428.308621:0:8029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b611180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8029:1875953111286528:0@lo:502: 00000020:01000000:1.0:1789048428.308641:0:8029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048428.308645:0:8029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048428.308647:0:8029:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789048428.308651:0:8029:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789048428.308789:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789048428.308811:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789048428.308831:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775b3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775b45 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048428.308843:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775b3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775b45 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048428.510491:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048429.534420:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111286656:0@lo:41: 00000100:00100000:2.0:1789048429.534489:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048429.534562:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111286656 00000100:00100000:2.0:1789048429.534570:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111286656 00000100:00100000:2.0:1789048429.534618:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789048429.534627:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111286656:12345-0@lo:41: 00000004:00000024:2.0:1789048429.534672:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1789048429.534717:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111286656:12345-0@lo:41: Request processed in 91us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048429.534724:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789048429.534771:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111286656:0@lo:41: 00010000:00010000:1.0:1789048429.538248:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048430.558719:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048431.069469:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789048431.069495:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111286784:0@lo:41: 00000100:00100000:3.0:1789048431.069558:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048431.074091:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111287040:0@lo:400: 00000100:00100000:3.0:1789048431.074158:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048431.074195:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789048431.074201:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111287168:0@lo:400: 00000100:00100000:3.0:1789048431.074237:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048431.074278:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111287040 00000100:00100000:3.0:1789048431.074285:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111287040 00000100:00100000:3.0:1789048431.074325:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789048431.074349:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111287040:12345-0@lo:400: 00000100:00100000:3.0:1789048431.074410:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111287040:12345-0@lo:400: Request processed in 77us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048431.074417:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789048431.074438:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111286784 00000100:00100000:3.0:1789048431.074441:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111286784 00000100:00100000:3.0:1789048431.074462:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111287168 00000100:00100000:3.0:1789048431.074464:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111287168 00000100:00100000:3.0:1789048431.074487:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789048431.074492:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111286784:12345-0@lo:41: 00000004:00000024:3.0:1789048431.074517:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789048431.074546:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111286784:12345-0@lo:41: Request processed in 54us (4988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048431.074552:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789048431.074563:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789048431.074569:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111287168:12345-0@lo:400: 00000100:00100000:3.0:1789048431.074593:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111287168:12345-0@lo:400: Request processed in 25us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048431.074598:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789048431.074623:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111286912:0@lo:400: 00000100:00100000:3.0:1789048431.074650:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048431.074690:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111286784:0@lo:41: 00000100:00100000:3.0:1789048431.074704:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789048431.074708:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111287296:0@lo:400: 00000100:00100000:3.0:1789048431.074727:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048431.074753:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111286912 00000100:00100000:3.0:1789048431.074756:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111286912 00000100:00100000:3.0:1789048431.074781:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789048431.074787:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:3623:x1875953111286912:12345-0@lo:400: 00000100:00100000:3.0:1789048431.074834:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:3623:x1875953111286912:12345-0@lo:400: Request processed in 48us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048431.074840:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789048431.074874:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111287168:0@lo:400: 00010000:00080000:3.0:1789048431.074885:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959c20220a80 x1875953111287040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048431.074902:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111287040:0@lo:400: 00000100:00100000:3.0:1789048431.074927:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111286912:0@lo:400: 00000100:00100000:1.0:1789048431.076987:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111287296 00000100:00100000:1.0:1789048431.077001:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111287296 00000100:00100000:1.0:1789048431.077056:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789048431.077065:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111287296:12345-0@lo:400: 00000100:00100000:1.0:1789048431.077439:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111287296:12345-0@lo:400: Request processed in 374us (2709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048431.077446:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789048431.077522:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959c20221880 x1875953111287296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048431.077535:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111287296:0@lo:400: 00010000:00010000:1.0:1789048431.585262:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048432.606541:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048433.634969:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048434.654893:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048434.654906:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789048434.654934:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111287424:0@lo:41: 00000100:00100000:2.0:1789048434.655022:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048434.655495:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111287424 00000100:00100000:3.0:1789048434.655507:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111287424 00000100:00100000:3.0:1789048434.655564:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789048434.655574:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111287424:12345-0@lo:41: 00000004:00000024:3.0:1789048434.655687:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1789048434.655750:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111287424:12345-0@lo:41: Request processed in 177us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048434.655769:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789048434.655952:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111287424:0@lo:41: 00010000:00010000:3.0:1789048435.689103:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048436.190414:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111287552:0@lo:400: 00000100:00100000:3.0:1789048436.190482:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048436.190546:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111287552 00000100:00100000:3.0:1789048436.190552:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111287552 00000100:00100000:3.0:1789048436.190593:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789048436.190602:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:3620:x1875953111287552:12345-0@lo:400: 00000100:00100000:1.0:1789048436.191844:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111287680:0@lo:41: 00000100:00100000:1.0:1789048436.191889:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048436.191931:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111287680 00000100:00100000:1.0:1789048436.191937:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111287680 00000100:00100000:1.0:1789048436.191969:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789048436.191976:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111287680:12345-0@lo:41: 00000004:00000024:1.0:1789048436.192003:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789048436.192040:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111287680:12345-0@lo:41: Request processed in 64us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048436.192047:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789048436.192089:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111287680:0@lo:41: 00000100:00100000:3.0:1789048436.194253:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:3620:x1875953111287552:12345-0@lo:400: Request processed in 3645us (3764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048436.194278:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789048436.206604:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111287552:0@lo:400: 00000100:00100000:3.0:1789048436.207265:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789048436.207278:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111287808:0@lo:400: 00000100:00100000:3.0:1789048436.207354:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048436.207392:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111287808 00000100:00100000:3.0:1789048436.207399:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111287808 00000100:00100000:3.0:1789048436.207440:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789048436.207449:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111287808:12345-0@lo:400: 00000100:00100000:3.0:1789048436.207494:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111287808:12345-0@lo:400: Request processed in 46us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048436.207501:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789048436.207536:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959c20221880 x1875953111287808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048436.207548:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111287808:0@lo:400: 00000100:00100000:3.0:1789048436.207574:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111287936:0@lo:400: 00000100:00100000:3.0:1789048436.207597:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048436.207621:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111287936 00000100:00100000:3.0:1789048436.207624:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111287936 00000100:00100000:1.0:1789048436.208817:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789048436.208830:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111288064:0@lo:400: 00000100:00100000:1.0:1789048436.208875:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048436.208906:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111288064 00000100:00100000:1.0:1789048436.208911:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111288064 00000100:00100000:1.0:1789048436.208942:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789048436.208950:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111288064:12345-0@lo:400: 00000100:00100000:1.0:1789048436.208991:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111288064:12345-0@lo:400: Request processed in 41us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048436.208998:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789048436.209029:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959c08a8f800 x1875953111288064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048436.209041:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111288064:0@lo:400: 00000100:00100000:3.0:1789048436.209693:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789048436.209704:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111287936:12345-0@lo:400: 00000100:00100000:3.0:1789048436.209766:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111287936:12345-0@lo:400: Request processed in 64us (2168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048436.209773:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789048436.216519:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111287936:0@lo:400: 00000020:01000004:3.0:1789048436.586405:0:8405:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789048436.586410:0:8405:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789048436.586412:0:8405:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789048436.586574:0:8405:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff959c41779800 00000020:01000004:3.0:1789048436.586594:0:8405:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789048436.586608:0:8405:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789048436.586625:0:8405:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff959c03e43380) 00000020:00000080:3.0:1789048436.586643:0:8405:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789048436.660710:0:8405:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789048436.660782:0:8405:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1789048436.694463:0:8405:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789048436.695009:0:8405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789048436.695022:0:8405:0:(osd_handler.c:8921:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789048436.695036:0:8405:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x133f221c08775b53 00000020:01000004:2.0:1789048436.695044:0:8405:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789048436.695067:0:8405:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789048436.695071:0:8405:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789048436.695077:0:8405:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789048436.695082:0:8405:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789048436.695105:0:8405:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff959c3ef799c0) 00000020:00000080:2.0:1789048436.695119:0:8405:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1789048436.706089:0:8405:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789048436.706562:0:8405:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789048436.706646:0:8405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00010000:00010000:0.0:1789048436.712729:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048436.723009:0:8405:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789048436.723028:0:8405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789048436.725815:0:8405:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789048436.725829:0:8405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789048436.727597:0:8405:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789048436.727825:0:8405:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789048436.727832:0:8405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789048436.751366:0:8405:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789048436.751747:0:8405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789048436.797692:0:8405:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789048436.798034:0:8405:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789048436.798044:0:8405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789048436.814147:0:8405:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789048436.814168:0:8405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789048436.823072:0:8405:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789048436.823086:0:8405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789048436.828861:0:8405:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789048436.829061:0:8405:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789048436.829067:0:8405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789048436.830963:0:8405:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789048436.830975:0:8405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789048436.936880:0:8405:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789048436.939865:0:8405:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789048436.939881:0:8405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789048436.945922:0:8405:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789048436.945935:0:8405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789048436.946437:0:8405:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789048436.946464:0:8405:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789048436.946470:0:8405:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789048436.996056:0:8405:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789048436.996102:0:8405:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.116@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789048436.996108:0:8405:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789048436.996109:0:8405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789048436.996111:0:8405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048436.996112:0:8405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048436.996113:0:8405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048436.996114:0:8405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048436.996115:0:8405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789048436.996117:0:8405:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789048436.996118:0:8405:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789048436.996119:0:8405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048436.996127:0:8405:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789048436.996132:0:8405:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789048436.996133:0:8405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789048436.996134:0:8405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789048436.996135:0:8405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048436.996136:0:8405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048436.996137:0:8405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048436.996138:0:8405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048436.996139:0:8405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789048436.996140:0:8405:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789048436.996141:0:8405:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789048436.996142:0:8405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048436.996143:0:8405:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789048436.996168:0:8405:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789048436.996185:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111288192:0@lo:253: 00000100:00100000:0.0:1789048436.996255:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048436.996400:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c115443c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048436.998520:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111288192 00000100:00100000:3.0:1789048436.998535:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111288192 00000100:00100000:3.0:1789048436.998613:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789048436.998626:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:8405:x1875953111288192:12345-0@lo:253: 20000000:01000000:3.0:1789048436.998681:0:6490:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789048436.998685:0:6490:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789048436.998690:0:6490:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789048436.998693:0:6490:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789048436.998974:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789048436.999150:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789048436.999164:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789048436.999182:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789048436.999189:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789048436.999202:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789048436.999218:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789048436.999300:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789048436.999315:0:6490:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.116@tcp 20000000:01000000:3.0:1789048436.999323:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:3.0:1789048436.999381:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789048436.999389:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789048436.999404:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789048436.999410:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:3.0:1789048436.999424:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789048436.999432:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789048436.999445:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789048436.999461:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789048436.999532:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1789048436.999543:0:6490:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.116@tcp 20000000:01000000:3.0:1789048436.999545:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:3.0:1789048436.999560:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1789048436.999566:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789048436.999591:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1789048436.999598:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:3.0:1789048436.999611:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1789048436.999616:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789048436.999627:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1789048436.999640:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1789048436.999998:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1789048437.000010:0:6490:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.116@tcp 20000000:01000000:3.0:1789048437.000012:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:3.0:1789048437.000026:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1789048437.000032:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789048437.000045:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1789048437.000050:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:3.0:1789048437.000063:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1789048437.000070:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789048437.000083:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1789048437.000109:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1789048437.000121:0:6490:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789048437.000123:0:6490:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789048437.000127:0:6490:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789048437.000178:0:6490:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789048437.000181:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789048437.004896:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1789048437.005319:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1789048437.005395:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1789048437.005413:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1789048437.005425:0:6490:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789048437.005428:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789048437.007662:0:8425:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1789048437.007717:0:8425:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1789048437.007749:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1789048437.008100:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1789048437.008124:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1789048437.008138:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:3.0:1789048437.008150:0:6490:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789048437.008153:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789048437.008615:0:8426:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1789048437.008636:0:8426:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1789048437.008649:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1789048437.008847:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1789048437.008868:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1789048437.008881:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1789048437.008891:0:6490:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789048437.008893:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789048437.009544:0:8427:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1789048437.011955:0:8427:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1789048437.011991:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1789048437.012924:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1789048437.012949:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1789048437.012964:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:2.0:1789048437.012978:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789048437.012996:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff959c02836e00/0x133f221c08775b61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.013014:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c0147ba00/0x133f221c08775a2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775a26 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.013023:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c0147ac00/0x133f221c08775aa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775a9d expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.013029:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c02837e00/0x133f221c08775adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775ad5 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.013035:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c02837c00/0x133f221c08775af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775af1 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.013055:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c013d6800/0x133f221c08775b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775b1b expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.013063:0:6490:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959c02836e00/0x133f221c08775b61 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.013101:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c013d6800/0x133f221c08775b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775b1b expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.013117:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c013d6800/0x133f221c08775b22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775b1b expref: 18 pid: 6490 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048437.013132:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6490:1875953111288320:0@lo:104: 00000100:00100000:2.0:1789048437.013202:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789048437.013259:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c02837c00/0x133f221c08775af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775af1 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.013268:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c02837c00/0x133f221c08775af8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775af1 expref: 18 pid: 6491 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048437.013277:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6490:1875953111288448:0@lo:104: 00000100:00100000:2.0:1789048437.013299:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789048437.013579:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c02837e00/0x133f221c08775adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775ad5 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.013588:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c02837e00/0x133f221c08775adc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775ad5 expref: 18 pid: 6491 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048437.013597:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6490:1875953111288576:0@lo:104: 00000100:00100000:2.0:1789048437.013639:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789048437.013862:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c0147ac00/0x133f221c08775aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775a9d expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.013872:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c0147ac00/0x133f221c08775aa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775a9d expref: 18 pid: 6492 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048437.013881:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6490:1875953111288704:0@lo:104: 00000100:00100000:2.0:1789048437.013913:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048437.017764:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111288320 00000100:00100000:3.0:1789048437.017779:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111288320 00000100:00100000:3.0:1789048437.017826:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111288448 00000100:00100000:3.0:1789048437.017828:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111288448 00000100:00100000:3.0:1789048437.017834:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111288576 00000100:00100000:3.0:1789048437.017836:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111288576 00000100:00100000:3.0:1789048437.017847:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789048437.017856:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+5:6490:x1875953111288320:12345-0@lo:104: 00010000:00010000:3.0:1789048437.017874:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c00031000/0x133f221c08775b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775b22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.018000:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789048437.018008:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+5:6490:x1875953111288320:12345-0@lo:104: Request processed in 153us (4807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048437.018016:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789048437.018046:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789048437.018051:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:6490:x1875953111288448:12345-0@lo:104: 00010000:00010000:3.0:1789048437.018057:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c00031600/0x133f221c08775af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775af8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.018860:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c0147ba00/0x133f221c08775a2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775a26 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.018875:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c0147ba00/0x133f221c08775a2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775a26 expref: 18 pid: 6491 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048437.018888:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6490:1875953111288832:0@lo:104: 00000100:00100000:2.0:1789048437.018924:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048437.018936:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef58c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789048437.018957:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6490:1875953111288320:0@lo:104: 00000100:00100000:2.0:1789048437.018966:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6490:1875953111288448:0@lo:104: 00010000:00010000:1.0:1789048437.019020:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789048437.019028:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c00031000/0x133f221c08775b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775b22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.019036:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c00031000 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048437.019040:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c00031000/0x133f221c08775b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775b22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.019046:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c00031000/0x133f221c08775b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775b22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048437.019051:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c00031000/0x133f221c08775b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775b22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048437.019054:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789048437.019083:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c00031000/0x133f221c08775b1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775b22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.019087:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048437.019103:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c00031000/0x133f221c08775b1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775b22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.019107:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c00031000/0x133f221c08775b1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775b22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.019124:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048437.019127:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c00031600/0x133f221c08775af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775af8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.019130:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c00031600 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048437.019132:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c00031600/0x133f221c08775af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775af8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.019136:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c00031600/0x133f221c08775af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775af8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048437.019139:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c00031600/0x133f221c08775af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775af8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048437.019142:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789048437.019151:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c00031600/0x133f221c08775af1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775af8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.019154:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048437.019164:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c00031600/0x133f221c08775af1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775af8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.019168:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c00031600/0x133f221c08775af1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775af8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.019174:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048437.019175:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048437.019176:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048437.019187:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111288960:0@lo:103: 00000100:00100000:1.0:1789048437.019237:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048437.019274:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111289088:0@lo:103: 00000100:00100000:1.0:1789048437.019296:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048437.019325:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111288960 00000100:00100000:1.0:1789048437.019328:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111288960 00010000:00010000:1.0:1789048437.019437:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c013d6800/0x133f221c08775b22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775b1b expref: 19 pid: 6490 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048437.019452:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111289088 00000100:00100000:1.0:1789048437.019454:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111289088 00010000:00010000:1.0:1789048437.019461:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c02837c00/0x133f221c08775af8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775af1 expref: 20 pid: 6491 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048437.019468:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789048437.019472:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:3621:x1875953111288960:12345-0@lo:103: 00010000:00010000:1.0:1789048437.019480:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048437.019483:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c013d6800/0x133f221c08775b22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775b1b expref: 20 pid: 6490 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.019489:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c013d6800/0x133f221c08775b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775b1b expref: 20 pid: 6490 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.019498:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c013d6800/0x133f221c08775b22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775b1b expref: 20 pid: 6490 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.019507:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048437.019527:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:3621:x1875953111288960:12345-0@lo:103: Request processed in 55us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048437.019531:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789048437.019541:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789048437.019550:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:3622:x1875953111289088:12345-0@lo:103: 00010000:00010000:1.0:1789048437.019562:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048437.019619:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c02837c00/0x133f221c08775af8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775af1 expref: 18 pid: 6491 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.019626:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c02837c00/0x133f221c08775af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775af1 expref: 18 pid: 6491 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.019633:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c02837c00/0x133f221c08775af8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775af1 expref: 18 pid: 6491 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.019640:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048437.019659:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:3622:x1875953111289088:12345-0@lo:103: Request processed in 110us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048437.019663:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789048437.019685:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111289088:0@lo:103: 00000100:00100000:1.0:1789048437.019699:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111288960:0@lo:103: 00000100:00100000:0.0:1789048437.019761:0:6479:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1789048437.019771:0:6479:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:1.0:1789048437.020097:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111288704 00000100:00100000:1.0:1789048437.020101:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111288704 00000100:00100000:1.0:1789048437.020121:0:6479:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1789048437.020126:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111288832 00000100:00100000:1.0:1789048437.020128:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111288832 00010000:00010000:3.0:1789048437.020188:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1789048437.020196:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+6:6490:x1875953111288448:12345-0@lo:104: Request processed in 2144us (6895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048437.020203:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789048437.020220:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789048437.020227:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+5:6490:x1875953111288576:12345-0@lo:104: 00010000:00010000:3.0:1789048437.020237:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775ad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775adc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.020287:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789048437.020293:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+5:6490:x1875953111288576:12345-0@lo:104: Request processed in 68us (6653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048437.020298:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789048437.020310:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789048437.020315:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:6490:x1875953111288704:12345-0@lo:104: 00010000:00010000:3.0:1789048437.020323:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775aa4 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.020453:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048437.020458:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775ad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775adc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.020465:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c00031200 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048437.020469:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775ad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775adc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.020486:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775ad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775adc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048437.020493:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775ad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775adc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048437.020499:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789048437.020520:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775ad5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775adc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.020527:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048437.020537:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775ad5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775adc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.020544:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775ad5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775adc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.020554:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048437.020555:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048437.020557:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048437.020563:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789048437.020583:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111289216:0@lo:103: 00000100:00100000:1.0:1789048437.020609:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048437.020638:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111289216 00000100:00100000:1.0:1789048437.020641:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111289216 00010000:00010000:1.0:1789048437.020656:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c02837e00/0x133f221c08775adc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775ad5 expref: 17 pid: 6491 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048437.020674:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789048437.020680:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:3622:x1875953111289216:12345-0@lo:103: 00010000:00010000:1.0:1789048437.020693:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048437.020697:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c02837e00/0x133f221c08775adc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775ad5 expref: 17 pid: 6491 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.020706:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c02837e00/0x133f221c08775adc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775ad5 expref: 17 pid: 6491 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.020716:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048437.020753:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:3622:x1875953111289216:12345-0@lo:103: Request processed in 73us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048437.020760:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789048437.020786:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111289216:0@lo:103: 00010000:00010000:2.0:1789048437.020918:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c02837e00/0x133f221c08775adc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775ad5 expref: 16 pid: 6491 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048437.020928:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6490:1875953111288576:0@lo:104: 00010000:00010000:3.0:1789048437.021013:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789048437.021019:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:6490:x1875953111288704:12345-0@lo:104: Request processed in 704us (7106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048437.021027:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789048437.021048:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789048437.021055:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:6490:x1875953111288832:12345-0@lo:104: 00010000:00010000:3.0:1789048437.021063:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775a26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775a2d expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.021096:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789048437.021101:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:6490:x1875953111288832:12345-0@lo:104: Request processed in 48us (2178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048437.021106:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789048437.021125:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789048437.021129:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775aa4 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.021135:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c00030a00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:3.0:1789048437.021138:0:7447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775aa4 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.021145:0:7447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775aa4 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789048437.021151:0:7447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775aa4 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048437.021156:0:7447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789048437.021175:0:7447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775a9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775aa4 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.021181:0:7447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789048437.021194:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775a9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775aa4 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.021210:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775a9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775aa4 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.021219:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048437.021222:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775a26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775a2d expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.021228:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c00030000 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:3.0:1789048437.021231:0:7447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775a26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775a2d expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.021237:0:7447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775a2d expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789048437.021244:0:7447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775a2d expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048437.021249:0:7447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789048437.021262:0:7447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775a26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775a2d expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.021269:0:7447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789048437.021274:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775a26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775a2d expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.021280:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775a26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775a2d expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.021291:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048437.021298:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048437.021300:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048437.021311:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111289344:0@lo:103: 00000100:00100000:2.0:1789048437.021486:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6490:1875953111288704:0@lo:104: 00000100:00100000:2.0:1789048437.021494:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6490:1875953111288832:0@lo:104: 00010000:00010000:2.0:1789048437.021516:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff959c02836e00/0x133f221c08775b61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048437.021662:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789048437.021748:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048437.021810:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789048437.021817:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111289472:0@lo:103: 00000100:00100000:3.0:1789048437.021841:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789048437.022046:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048437.022101:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111289344 00000100:00100000:2.0:1789048437.022107:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111289344 00010000:00010000:2.0:1789048437.022132:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c0147ac00/0x133f221c08775aa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775a9d expref: 16 pid: 6492 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048437.022191:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111289472 00000100:00100000:2.0:1789048437.022195:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111289472 00010000:00010000:2.0:1789048437.022207:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c0147ba00/0x133f221c08775a2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775a26 expref: 17 pid: 6491 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048437.022237:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789048437.022246:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:3620:x1875953111289344:12345-0@lo:103: 00010000:00010000:1.0:1789048437.022257:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048437.022261:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c0147ac00/0x133f221c08775aa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775a9d expref: 17 pid: 6492 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.022271:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c0147ac00/0x133f221c08775aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775a9d expref: 17 pid: 6492 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.022283:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c0147ac00/0x133f221c08775aa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775a9d expref: 17 pid: 6492 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.022294:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048437.022367:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:3620:x1875953111289344:12345-0@lo:103: Request processed in 122us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048437.022373:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789048437.022398:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789048437.022405:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2aecc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:3620:x1875953111289472:12345-0@lo:103: 00010000:00010000:1.0:1789048437.022412:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048437.022417:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c0147ba00/0x133f221c08775a2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775a26 expref: 15 pid: 6491 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.022425:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c0147ba00/0x133f221c08775a2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775a26 expref: 15 pid: 6491 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.022434:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c0147ba00/0x133f221c08775a2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775a26 expref: 15 pid: 6491 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.022445:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959c02836e00/0x133f221c08775b61 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.022452:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c02836e00/0x133f221c08775b61 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.022466:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c02836e00/0x133f221c08775b61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.022474:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c02836e00/0x133f221c08775b61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.022480:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff959c02836e00/0x133f221c08775b61 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.022487:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff959c02836e00/0x133f221c08775b61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.022493:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836e00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048437.022497:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff959c02836e00/0x133f221c08775b61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.022511:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff959c02836e00/0x133f221c08775b61 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.022526:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff959c02836e00/0x133f221c08775b61 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.022536:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048437.022560:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2aecc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:3620:x1875953111289472:12345-0@lo:103: Request processed in 156us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048437.023449:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789048437.023752:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111289472:0@lo:103: 00000100:00100000:0.0:1789048437.023764:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111289344:0@lo:103: 00010000:00010000:2.0:1789048437.023933:0:6490:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff959c02836e00/0x133f221c08775b61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.023944:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff959c02836e00/0x133f221c08775b61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.023951:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c02836e00/0x133f221c08775b61 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789048437.023974:0:6490:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789048437.028639:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111288192:0@lo:253: 00000100:00100000:0.0:1789048437.028643:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+13:8405:x1875953111288192:12345-0@lo:253: Request processed in 29936us (32304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048437.028660:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 10000000:01000000:2.0:1789048437.028683:0:8405:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789048437.028689:0:8405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789048437.028692:0:8405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789048437.028693:0:8405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048437.028696:0:8405:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789048437.028698:0:8405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048437.028700:0:8405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048437.028702:0:8405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789048437.028705:0:8405:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789048437.028707:0:8405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048437.028710:0:8405:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789048437.028761:0:8405:0:(tgt_mount.c:101:server_register_mount()) register mount ffff959c41779800 from lustre-OST0000 10000000:01000000:2.0:1789048437.028814:0:8405:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789048437.028818:0:8405:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789048437.028828:0:8405:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff959c394bb380 local copy 10000000:01000000:2.0:1789048437.028834:0:8405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789048437.029011:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775b68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.029024:0:8405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775b68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.029034:0:8405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775b68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048437.029059:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111289600:0@lo:101: 00000100:00100000:2.0:1789048437.029121:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048437.029171:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef58300 going to sleep for 11 seconds 00000100:00100000:0.0:1789048437.029883:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111289600 00000100:00100000:0.0:1789048437.029894:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111289600 00000100:00100000:0.0:1789048437.029968:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789048437.029977:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+13:8405:x1875953111289600:12345-0@lo:101: 00010000:00010000:0.0:1789048437.029993:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048437.030013:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c00030800/0x133f221c08775b6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775b68 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048437.030059:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c00030800/0x133f221c08775b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775b68 expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048437.030070:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c00030800/0x133f221c08775b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775b68 expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048437.030079:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c00030800, rc 0) 00000100:00100000:0.0:1789048437.030136:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:8405:x1875953111289600:12345-0@lo:101: Request processed in 161us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048437.030143:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789048437.030256:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111289600:0@lo:101: 00010000:00010000:2.0:1789048437.030282:0:8405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775b68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x133f221c08775b6f expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.030294:0:8405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775b68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x133f221c08775b6f expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048437.030487:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111289728:0@lo:501: 00000100:00100000:2.0:1789048437.030531:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048437.030565:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef58300 going to sleep for 11 seconds 00000100:00100000:0.0:1789048437.030698:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111289728 00000100:00100000:0.0:1789048437.030705:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111289728 00000100:00100000:0.0:1789048437.030750:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789048437.030758:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:8405:x1875953111289728:12345-0@lo:501: 00000100:00100000:0.0:1789048437.030853:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:8405:x1875953111289728:12345-0@lo:501: Request processed in 96us (322us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789048437.030859:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789048437.031275:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111289728:0@lo:501: 10000000:01000000:2.0:1789048437.031292:0:8405:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789048437.031331:0:8405:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789048437.031399:0:8405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775b68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x133f221c08775b6f expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.031409:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775b68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x133f221c08775b6f expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.031418:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775b68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x133f221c08775b6f expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.031441:0:8405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789048437.031480:0:8405:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff959c41779800 00010000:00010000:0.0:1789048437.031481:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1789048437.031488:0:8405:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789048437.031497:0:8405:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 00010000:00010000:0.0:1789048437.031500:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775b68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x133f221c08775b6f expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048437.031501:0:8405:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789048437.031511:0:8405:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 00010000:00010000:0.0:1789048437.031517:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837600 already unused, calling callback (ffffffffc1289c20) 10000000:01000000:2.0:1789048437.031518:0:8405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 10000000:00010000:0.0:1789048437.031527:0:7447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775b68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x133f221c08775b6f expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048437.031540:0:7447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x133f221c08775b6f expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.031554:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775b76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.031570:0:8405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775b76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.031581:0:8405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775b76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048437.031606:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111289856:0@lo:101: 10000000:00010000:0.0:1789048437.031624:0:7447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x133f221c08775b6f expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048437.031630:0:7447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789048437.031659:0:7447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775b68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x133f221c08775b6f expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048437.031663:0:7447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789048437.031687:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775b68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x133f221c08775b6f expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048437.031692:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775b68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x133f221c08775b6f expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048437.031702:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048437.031703:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048437.031704:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048437.031755:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111289984:0@lo:103: 00000100:00100000:1.0:1789048437.031799:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048437.032025:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111289984 00000100:00100000:0.0:1789048437.032030:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111289984 00000100:00100000:0.0:1789048437.032063:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789048437.032067:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:3622:x1875953111289984:12345-0@lo:103: 00010000:00010000:0.0:1789048437.032075:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048437.032085:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c00030800/0x133f221c08775b6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08775b68 expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048437.032097:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048437.032119:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+13:3622:x1875953111289984:12345-0@lo:103: Request processed in 52us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048437.032123:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789048437.032184:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111289984:0@lo:103: 00000100:00100000:2.0:1789048437.033148:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048437.033209:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111289856 00000100:00100000:1.0:1789048437.033217:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111289856 00000100:00100000:1.0:1789048437.033263:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789048437.033270:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+13:8405:x1875953111289856:12345-0@lo:101: 00010000:00010000:1.0:1789048437.033283:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048437.033300:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c013d6800/0x133f221c08775b7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775b76 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.033321:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c013d6800/0x133f221c08775b7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775b76 expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.033416:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c013d6800/0x133f221c08775b7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775b76 expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.033425:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c013d6800, rc 0) 00000100:00100000:1.0:1789048437.033476:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:8405:x1875953111289856:12345-0@lo:101: Request processed in 207us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048437.033483:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789048437.034266:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef58180 going to sleep for 11 seconds 00000100:00100000:2.0:1789048437.034303:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111289856:0@lo:101: 00010000:00010000:2.0:1789048437.034361:0:8405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775b76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775b7d expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.034374:0:8405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775b76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775b7d expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048437.034510:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111290112:0@lo:501: 00000100:00100000:2.0:1789048437.034560:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048437.034581:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef58180 going to sleep for 11 seconds 00000100:00100000:1.0:1789048437.035700:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111290112 00000100:00100000:1.0:1789048437.035710:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111290112 00000100:00100000:1.0:1789048437.035762:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789048437.035775:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:8405:x1875953111290112:12345-0@lo:501: 00000100:00100000:1.0:1789048437.035928:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:8405:x1875953111290112:12345-0@lo:501: Request processed in 154us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048437.035935:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789048437.036755:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111290112:0@lo:501: 00000100:00100000:0.0:1789048437.036805:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111290240:0@lo:503: 00000100:00100000:0.0:1789048437.036864:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048437.036904:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2ae25000 going to sleep for 11 seconds 00000100:00100000:1.0:1789048437.037051:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111290240 00000100:00100000:1.0:1789048437.037056:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111290240 00000100:00100000:1.0:1789048437.037093:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789048437.037101:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:8405:x1875953111290240:12345-0@lo:503: 00000100:00100000:1.0:1789048437.037194:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:8405:x1875953111290240:12345-0@lo:503: Request processed in 94us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048437.037201:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789048437.038069:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111290240:0@lo:503: 00000040:00080000:0.0:1789048437.038314:0:8405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789048437.038430:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111290368:0@lo:502: 00000100:00100000:0.0:1789048437.038476:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048437.038501:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2ae25000 going to sleep for 11 seconds 00000100:00100000:1.0:1789048437.038559:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111290368 00000100:00100000:1.0:1789048437.038565:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111290368 00000100:00100000:1.0:1789048437.038667:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789048437.038675:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:8405:x1875953111290368:12345-0@lo:502: 00000100:00100000:1.0:1789048437.038773:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:8405:x1875953111290368:12345-0@lo:502: Request processed in 98us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048437.038781:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789048437.039691:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111290368:0@lo:502: 00000040:00080000:0.0:1789048437.039912:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789048437.039939:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789048437.041699:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789048437.041742:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789048437.041762:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789048437.041777:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789048437.041832:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111290496:0@lo:502: 00000100:00100000:1.0:1789048437.041903:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048437.041948:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c034fd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048437.041974:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111290496 00000100:00100000:3.0:1789048437.041981:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111290496 00000100:00100000:3.0:1789048437.042033:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789048437.042042:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:8405:x1875953111290496:12345-0@lo:502: 00000100:00100000:3.0:1789048437.042138:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:8405:x1875953111290496:12345-0@lo:502: Request processed in 96us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048437.042145:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789048437.042699:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111290496:0@lo:502: 00000040:00080000:1.0:1789048437.042752:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789048437.042763:0:8405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789048437.043193:0:8429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789048437.043200:0:8429:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789048437.043208:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048437.043210:0:8429:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789048437.043216:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789048437.043230:0:8429:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff959c03e44d40) 00000020:00000080:3.0:1789048437.043259:0:8429:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789048437.043265:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789048437.043366:0:8429:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c41779800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789048437.043374:0:8429:0:(osd_handler.c:8921:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789048437.043380:0:8429:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x133f221c08775b8b 00010000:00010000:2.0:1789048437.051199:0:8429:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1789048437.051638:0:8429:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789048437.055035:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789048437.058970:0:8429:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789048437.064976:0:8429:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1789048437.065170:0:8429:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1789048437.091790:0:8429:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1789048437.099903:0:8429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789048437.099916:0:8429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048437.099922:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048437.099924:0:8429:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789048437.099927:0:8429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048437.099931:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048437.099933:0:8429:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789048437.099936:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789048437.099938:0:8429:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789048437.099958:0:8429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048437.099961:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048437.099963:0:8429:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789048437.099966:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789048437.100040:0:8405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789048437.100069:0:8405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789048437.100095:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775b76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775b7d expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.100107:0:8405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775b76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775b7d expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048437.100116:0:8405:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c41779800 from 1 10000000:01000000:1.0:1789048437.100119:0:8405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789048437.100154:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c013d6000/0x133f221c08775b92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.100162:0:8405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c013d6000/0x133f221c08775b92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.100174:0:8405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c013d6000/0x133f221c08775b92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048437.100196:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111290624:0@lo:101: 00000100:00100000:1.0:1789048437.100260:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048437.100306:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c034fd300 going to sleep for 11 seconds 00000100:00100000:2.0:1789048437.102122:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111290624 00000100:00100000:2.0:1789048437.102134:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111290624 00000100:00100000:2.0:1789048437.102196:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789048437.102206:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:8405:x1875953111290624:12345-0@lo:101: 00010000:00010000:2.0:1789048437.102221:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048437.102237:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c02837e00/0x133f221c08775b99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775b92 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.102262:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c02837e00/0x133f221c08775b99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775b92 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.102273:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c02837e00/0x133f221c08775b99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775b92 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.102282:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02837e00, rc 0) 00000100:00100000:2.0:1789048437.102360:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:8405:x1875953111290624:12345-0@lo:101: Request processed in 154us (2099us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048437.102378:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789048437.102393:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111290624:0@lo:101: 00010000:00010000:1.0:1789048437.102414:0:8405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c013d6000/0x133f221c08775b92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775b99 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.102424:0:8405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c013d6000/0x133f221c08775b92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775b99 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048437.102514:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111290752:0@lo:501: 00000100:00100000:1.0:1789048437.102545:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048437.102590:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c034fd300 going to sleep for 11 seconds 00000100:00100000:3.0:1789048437.102949:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111290752 00000100:00100000:3.0:1789048437.102965:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111290752 00000100:00100000:3.0:1789048437.102997:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789048437.103005:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:8405:x1875953111290752:12345-0@lo:501: 00000100:00100000:3.0:1789048437.103100:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:8405:x1875953111290752:12345-0@lo:501: Request processed in 95us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048437.103106:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789048437.103140:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111290752:0@lo:501: 00000100:00100000:3.0:1789048437.103168:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111290880:0@lo:503: 00000100:00100000:3.0:1789048437.103204:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048437.103219:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c4153e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048437.103232:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111290880 00000100:00100000:3.0:1789048437.103235:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111290880 00000100:00100000:3.0:1789048437.103252:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789048437.103257:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:8405:x1875953111290880:12345-0@lo:503: 00000100:00100000:2.0:1789048437.103389:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111290880:0@lo:503: 00000100:00100000:3.0:1789048437.103464:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:8405:x1875953111290880:12345-0@lo:503: Request processed in 206us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048437.103476:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000040:00080000:2.0:1789048437.103657:0:8405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789048437.103728:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111291008:0@lo:502: 00000100:00100000:2.0:1789048437.103774:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048437.103811:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef58540 going to sleep for 11 seconds 00000100:00100000:3.0:1789048437.103816:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111291008 00000100:00100000:3.0:1789048437.103821:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111291008 00000100:00100000:3.0:1789048437.103850:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789048437.103857:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:8405:x1875953111291008:12345-0@lo:502: 00000100:00100000:3.0:1789048437.103939:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:8405:x1875953111291008:12345-0@lo:502: Request processed in 82us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048437.103946:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789048437.104034:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111291008:0@lo:502: 00000040:00080000:1.0:1789048437.104301:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789048437.104327:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789048437.104431:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111291136:0@lo:502: 00000100:00100000:1.0:1789048437.104465:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048437.104479:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c034fdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789048437.104494:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111291136 00000100:00100000:1.0:1789048437.104498:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111291136 00000100:00100000:1.0:1789048437.104517:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789048437.104523:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:8405:x1875953111291136:12345-0@lo:502: 00000100:00100000:1.0:1789048437.104665:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:8405:x1875953111291136:12345-0@lo:502: Request processed in 142us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048437.104672:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789048437.104708:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111291136:0@lo:502: 00000040:00080000:1.0:1789048437.104886:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789048437.104895:0:8405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789048437.105902:0:8433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048437.105912:0:8433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048437.105915:0:8433:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789048437.105922:0:8433:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959c41779800 00000020:00000080:3.0:1789048437.105924:0:8433:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789048437.105933:0:8433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048437.105936:0:8433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048437.105937:0:8433:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789048437.105940:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789048437.106910:0:8405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789048437.106940:0:8405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789048437.107816:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c013d6000/0x133f221c08775b92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775b99 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.107830:0:8405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c013d6000/0x133f221c08775b92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775b99 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048437.107884:0:8405:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789048437.107887:0:8405:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff959c41779800 10000000:01000000:1.0:1789048437.107890:0:8405:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff959c41779800 10000000:01000000:1.0:1789048437.107894:0:8405:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789048437.107900:0:8405:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959c41779800 from 1 10000000:01000000:1.0:1789048437.107902:0:8405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789048437.107932:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c013d7400/0x133f221c08775ba0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.107940:0:8405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c013d7400/0x133f221c08775ba0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.108411:0:8405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c013d7400/0x133f221c08775ba0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048437.108436:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111291264:0@lo:101: 00000100:00100000:1.0:1789048437.108491:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048437.108524:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c034fdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048437.108545:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111291264 00000100:00100000:1.0:1789048437.108551:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111291264 00000100:00100000:1.0:1789048437.108597:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789048437.108605:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:8405:x1875953111291264:12345-0@lo:101: 00010000:00010000:1.0:1789048437.108617:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048437.108630:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c013d6600/0x133f221c08775ba7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775ba0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.108658:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c013d6600/0x133f221c08775ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775ba0 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.108668:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c013d6600/0x133f221c08775ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775ba0 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.108676:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c013d6600, rc 0) 00000100:00100000:1.0:1789048437.108708:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:8405:x1875953111291264:12345-0@lo:101: Request processed in 104us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048437.108714:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789048437.110002:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111291264:0@lo:101: 00010000:00010000:1.0:1789048437.110021:0:8405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c013d7400/0x133f221c08775ba0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775ba7 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.110033:0:8405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c013d7400/0x133f221c08775ba0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775ba7 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048437.110120:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111291392:0@lo:501: 00000100:00100000:1.0:1789048437.110152:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048437.110171:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c034fdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048437.110188:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111291392 00000100:00100000:1.0:1789048437.110194:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111291392 00000100:00100000:1.0:1789048437.110223:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789048437.110231:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:8405:x1875953111291392:12345-0@lo:501: 00000100:00100000:1.0:1789048437.110328:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:8405:x1875953111291392:12345-0@lo:501: Request processed in 97us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048437.110353:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789048437.110393:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111291392:0@lo:501: 00000100:00100000:1.0:1789048437.110417:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111291520:0@lo:503: 00000100:00100000:1.0:1789048437.110451:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048437.110464:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c034fdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048437.110476:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111291520 00000100:00100000:1.0:1789048437.110479:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111291520 00000100:00100000:1.0:1789048437.110498:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789048437.110503:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:8405:x1875953111291520:12345-0@lo:503: 00000100:00100000:1.0:1789048437.110584:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:8405:x1875953111291520:12345-0@lo:503: Request processed in 80us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048437.110591:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789048437.110628:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111291520:0@lo:503: 00000040:00080000:1.0:1789048437.110852:0:8405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789048437.110916:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111291648:0@lo:502: 00000100:00100000:1.0:1789048437.112865:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048437.112907:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c034fdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048437.116036:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111291648 00000100:00100000:2.0:1789048437.116049:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111291648 00000100:00100000:2.0:1789048437.116110:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789048437.116120:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:8405:x1875953111291648:12345-0@lo:502: 00000100:00100000:2.0:1789048437.116310:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:8405:x1875953111291648:12345-0@lo:502: Request processed in 191us (3447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048437.116318:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789048437.120492:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111291648:0@lo:502: 00000040:00080000:1.0:1789048437.120800:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789048437.120832:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789048437.120848:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789048437.120863:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789048437.120876:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789048437.120889:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789048437.120903:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789048437.120917:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789048437.120932:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789048437.120946:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789048437.120968:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789048437.120994:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789048437.121009:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789048437.121022:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789048437.121035:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789048437.121048:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789048437.121060:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789048437.121073:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789048437.121085:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789048437.121098:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789048437.121110:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789048437.121123:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789048437.121136:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789048437.121149:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789048437.121162:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789048437.121176:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789048437.121190:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789048437.121216:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1789048437.121234:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789048437.121247:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1789048437.121262:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1789048437.121277:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1789048437.121293:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1789048437.121306:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1789048437.121321:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1789048437.121385:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1789048437.121403:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1789048437.121441:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111291776:0@lo:502: 00000100:00100000:1.0:1789048437.121517:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048437.121561:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c034fdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048437.121770:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111291776 00000100:00100000:2.0:1789048437.121778:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111291776 00000100:00100000:2.0:1789048437.121841:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789048437.121966:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:8405:x1875953111291776:12345-0@lo:502: 00000100:00100000:2.0:1789048437.122088:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:8405:x1875953111291776:12345-0@lo:502: Request processed in 127us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048437.122096:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789048437.122282:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111291776:0@lo:502: 00000040:00080000:0.0:1789048437.122396:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1789048437.122406:0:8405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789048437.123425:0:8434:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789048437.123440:0:8434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff959c2022cd40) 00000020:00000080:1.0:1789048437.123467:0:8434:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1789048437.123554:0:8434:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c41779800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789048437.123559:0:8434:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959c41779800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789048437.123561:0:8434:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c41779800 3 00010000:00080000:1.0:1789048437.123587:0:8434:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959c3e9dc800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1789048437.127754:0:8434:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1789048437.127931:0:8434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789048437.127969:0:8434:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789048437.127990:0:8434:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x133f221c08775bb5 00000100:00080000:1.0:1789048437.128000:0:8434:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789048437.128010:0:8434:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff959c3e9dc800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048437.128040:0:8434:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b05d81180 x1875953111291904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789048437.128062:0:8434:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789048437.128135:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111292416:0@lo:400: 00000100:00100000:1.0:1789048437.128188:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048437.128215:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789048437.128220:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111292032:0@lo:400: 00000100:00100000:1.0:1789048437.128238:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048437.128260:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111292416 00000100:00100000:1.0:1789048437.128266:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111292416 00000100:00100000:1.0:1789048437.128297:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789048437.128303:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111292416:12345-0@lo:400: 00000100:00100000:1.0:1789048437.128367:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111292416:12345-0@lo:400: Request processed in 64us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048437.128374:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789048437.128406:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111292416:0@lo:400: 00000100:00100000:3.0:1789048437.129431:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111291904:0@lo:38: 00000100:00100000:3.0:1789048437.129481:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048437.129529:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111292288:0@lo:400: 00000100:00100000:3.0:1789048437.129550:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048437.129578:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789048437.129584:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111292160:0@lo:400: 00000100:00100000:3.0:1789048437.129603:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048437.129627:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111292032 00000100:00100000:3.0:1789048437.129632:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111292032 00000100:00100000:3.0:1789048437.129657:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111291904 00000100:00100000:3.0:1789048437.129659:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111291904 00000100:00100000:3.0:1789048437.129673:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111292288 00000100:00100000:3.0:1789048437.129676:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111292288 00000100:00100000:3.0:1789048437.129687:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789048437.129693:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111292032:12345-0@lo:400: 00000100:00100000:3.0:1789048437.129730:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111292032:12345-0@lo:400: Request processed in 36us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048437.129750:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789048437.129763:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789048437.129769:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111292288:12345-0@lo:400: 00000100:00100000:3.0:1789048437.129797:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111292288:12345-0@lo:400: Request processed in 28us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048437.129803:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789048437.129814:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789048437.129818:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111291904:12345-0@lo:38: 00010000:00080000:3.0:1789048437.129836:0:6497:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:3.0:1789048437.129865:0:6497:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x133f221c08775bbc 00000004:00100000:3.0:1789048437.129878:0:6497:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789048437.129905:0:6497:0:(import.c:65:import_set_state_nolock()) ffff959c3e83f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789048437.129940:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875953111291904:12345-0@lo:38: Request processed in 121us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048437.129946:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789048437.130442:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111292160 00000100:00100000:3.0:1789048437.130447:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111292160 00000100:00100000:3.0:1789048437.130473:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789048437.130480:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111292160:12345-0@lo:400: 00000100:00100000:3.0:1789048437.130512:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111292160:12345-0@lo:400: Request processed in 33us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048437.130527:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789048437.130557:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111292160:0@lo:400: 00010000:00080000:3.0:1789048437.130633:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959b05d81880 x1875953111292288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048437.130644:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111292288:0@lo:400: 00010000:00080000:3.0:1789048437.130673:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959b05d81180 x1875953111291904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789048447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048437.130681:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789048437.130687:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789048437.130694:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789048437.130699:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789048437.130701:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3e9dc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789048437.130706:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111291904:0@lo:38: 00010000:00080000:3.0:1789048437.130800:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959b05d81f80 x1875953111292032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048437.130809:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111292032:0@lo:400: 00000020:01000004:2.0:1789048437.132763:0:8434:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789048437.132780:0:8434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff959c3ef78000) 00000020:00000080:2.0:1789048437.132803:0:8434:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1789048437.133077:0:8434:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c41779800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789048437.133082:0:8434:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959c41779800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789048437.133085:0:8434:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c41779800 3 00010000:00080000:2.0:1789048437.133121:0:8434:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959b06838000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.116@tcp at head 00010000:00010000:2.0:1789048437.143080:0:8434:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1789048437.143285:0:8434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1789048437.143323:0:8434:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789048437.143351:0:8434:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x133f221c08775bca 00000100:00080000:2.0:1789048437.143362:0:8434:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789048437.143373:0:8434:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff959b06838000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048437.143406:0:8434:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b05d75500 x1875953111292544/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789048437.143432:0:8434:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789048437.143514:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3619:1875953111292544:0@lo:38: 00000100:00100000:0.0:1789048437.143577:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048437.147962:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111292544 00000100:00100000:2.0:1789048437.147976:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111292544 00000100:00100000:2.0:1789048437.148027:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789048437.148034:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111292544:12345-0@lo:38: 00010000:00080000:2.0:1789048437.148062:0:6497:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:2.0:1789048437.148114:0:6497:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x133f221c08775bd1 00000004:00100000:2.0:1789048437.148129:0:6497:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789048437.148161:0:6497:0:(import.c:65:import_set_state_nolock()) ffff959b06838800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789048437.148242:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875953111292544:12345-0@lo:38: Request processed in 207us (4664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048437.148249:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:2.0:1789048437.148370:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00010000:00080000:0.0:1789048437.162433:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959b05d75500 x1875953111292544/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789048447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048437.162453:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789048437.162465:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789048437.162474:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789048437.162480:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789048437.162484:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b06838000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789048437.162491:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3619:1875953111292544:0@lo:38: 00000020:01000000:0.0:1789048437.162538:0:8405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1789048437.162578:0:8405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789048437.162597:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c013d7400/0x133f221c08775ba0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775ba7 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048437.162607:0:8405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c013d7400/0x133f221c08775ba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775ba7 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789048437.162655:0:8405:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789048437.162657:0:8405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789048437.162659:0:8405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048437.162660:0:8405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048437.162661:0:8405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048437.162663:0:8405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048437.162665:0:8405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789048437.162667:0:8405:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789048437.162668:0:8405:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789048437.162670:0:8405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048437.162671:0:8405:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789048437.162675:0:8405:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1789048437.162678:0:8405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789048437.162679:0:8405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789048437.162680:0:8405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048437.162682:0:8405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048437.162683:0:8405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048437.162684:0:8405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048437.162685:0:8405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789048437.162686:0:8405:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789048437.162686:0:8405:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789048437.162687:0:8405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048437.162688:0:8405:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789048437.162709:0:8405:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789048437.162724:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d313100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111292672:0@lo:253: 00000100:00100000:0.0:1789048437.163357:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048437.163400:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c5da80 going to sleep for 11 seconds 00000100:00100000:2.0:1789048437.163538:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111292672 00000100:00100000:2.0:1789048437.163546:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111292672 00000100:00100000:2.0:1789048437.163605:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789048437.163615:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:8405:x1875953111292672:12345-0@lo:253: 20000000:01000000:2.0:1789048437.163645:0:6492:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789048437.163668:0:6492:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789048437.180701:0:6492:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789048437.180723:0:6492:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789048437.180848:0:6513:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789048437.180854:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789048437.180877:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff959c0147a400/0x133f221c08775bd8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.180895:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c02837400/0x133f221c08775ace lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775ac7 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.180903:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c0147b800/0x133f221c08775aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775ae3 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.180924:0:6513:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959c0147a400/0x133f221c08775bd8 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.180975:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c0147b800/0x133f221c08775aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775ae3 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.180988:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c0147b800/0x133f221c08775aea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775ae3 expref: 16 pid: 6492 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048437.181002:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d89180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875953111292800:0@lo:104: 00000100:00100000:3.0:1789048437.181066:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789048437.181119:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c02837400/0x133f221c08775ace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775ac7 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.181127:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c02837400/0x133f221c08775ace lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775ac7 expref: 16 pid: 6492 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048437.181136:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d8b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875953111292928:0@lo:104: 00000100:00100000:3.0:1789048437.181156:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c4153e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048437.181283:0:6479:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789048437.181302:0:6479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048437.181370:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111292800 00000100:00100000:1.0:1789048437.181378:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111292800 00000100:00100000:1.0:1789048437.181416:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111292928 00000100:00100000:1.0:1789048437.181419:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111292928 00000100:00100000:1.0:1789048437.181433:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789048437.181442:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3eb66c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:6513:x1875953111292800:12345-0@lo:104: 00000100:00100000:0.0:1789048437.181446:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1789048437.181455:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775ae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775aea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048437.181460:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:6513:x1875953111292928:12345-0@lo:104: 00010000:00010000:0.0:1789048437.181467:0:8428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c013d7a00/0x133f221c08775ac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775ace expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.181582:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789048437.181588:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3eb66c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:6513:x1875953111292800:12345-0@lo:104: Request processed in 148us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048437.181595:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1789048437.181634:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048437.181640:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775ae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775aea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.181647:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836c00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048437.181651:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775ae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775aea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.181659:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775aea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048437.181666:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775aea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048437.181671:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789048437.181703:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775ae3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775aea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.181709:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048437.181723:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775ae3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775aea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.181729:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775ae3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775aea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.181754:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048437.181756:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048437.181757:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048437.181927:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111293056:0@lo:103: 00000100:00100000:3.0:1789048437.181970:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048437.182096:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111293056 00000100:00100000:1.0:1789048437.182101:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111293056 00010000:00010000:1.0:1789048437.182119:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c0147b800/0x133f221c08775aea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775ae3 expref: 17 pid: 6492 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048437.182148:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789048437.182154:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:3623:x1875953111293056:12345-0@lo:103: 00010000:00010000:1.0:1789048437.182164:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048437.182168:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c0147b800/0x133f221c08775aea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775ae3 expref: 17 pid: 6492 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.182177:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c0147b800/0x133f221c08775aea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775ae3 expref: 17 pid: 6492 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048437.182191:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048437.182218:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:3623:x1875953111293056:12345-0@lo:103: Request processed in 64us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048437.182225:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789048437.182396:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111293056:0@lo:103: 00000100:00100000:3.0:1789048437.186305:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:8405:x1875953111292672:12345-0@lo:253: Request processed in 22683us (22965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048437.186319:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789048437.186498:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d313100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8405:1875953111292672:0@lo:253: 10000000:01000000:1.0:1789048437.186513:0:8405:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789048437.186516:0:8405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789048437.186517:0:8405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789048437.186519:0:8405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789048437.186520:0:8405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789048437.186521:0:8405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789048437.186522:0:8405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789048437.186524:0:8405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789048437.186526:0:8405:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789048437.186527:0:8405:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789048437.186528:0:8405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789048437.186530:0:8405:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789048437.186543:0:8405:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1789048437.186943:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789048437.186952:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:6513:x1875953111292928:12345-0@lo:104: Request processed in 5492us (5648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048437.186961:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1789048437.186972:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c0147b800/0x133f221c08775aea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775ae3 expref: 15 pid: 6492 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048437.186988:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d89180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875953111292800:0@lo:104: 00000100:00100000:2.0:1789048437.187000:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d8b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875953111292928:0@lo:104: 00010000:00010000:2.0:1789048437.187018:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff959c0147a400/0x133f221c08775bd8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.187118:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048437.187125:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c013d7a00/0x133f221c08775ac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775ace expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.187143:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c013d7a00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:3.0:1789048437.187146:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c013d7a00/0x133f221c08775ac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775ace expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.187156:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c013d7a00/0x133f221c08775ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775ace expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789048437.187163:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c013d7a00/0x133f221c08775ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775ace expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048437.187170:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789048437.187211:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c013d7a00/0x133f221c08775ac7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775ace expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.187218:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789048437.187245:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c013d7a00/0x133f221c08775ac7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775ace expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.187252:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c013d7a00/0x133f221c08775ac7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775ace expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.187269:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048437.187271:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048437.187272:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048437.187281:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789048437.187294:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111293184:0@lo:103: 00000100:00100000:3.0:1789048437.187496:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048437.187552:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111293184 00000100:00100000:3.0:1789048437.187560:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111293184 00010000:00010000:3.0:1789048437.187590:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c02837400/0x133f221c08775ace lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775ac7 expref: 15 pid: 6492 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048437.187617:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789048437.187626:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:3621:x1875953111293184:12345-0@lo:103: 00010000:00010000:3.0:1789048437.187638:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048437.187644:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c02837400/0x133f221c08775ace lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775ac7 expref: 15 pid: 6492 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.187654:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c02837400/0x133f221c08775ace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775ac7 expref: 15 pid: 6492 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.187668:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c02837400/0x133f221c08775ace lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775ac7 expref: 15 pid: 6492 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.187682:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959c0147a400/0x133f221c08775bd8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.187691:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c0147a400/0x133f221c08775bd8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789048437.187705:0:6481:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007010859s 00010000:00010000:3.0:1789048437.187709:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c0147a400/0x133f221c08775bd8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.187717:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c0147a400/0x133f221c08775bd8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.187725:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff959c0147a400/0x133f221c08775bd8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.187743:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff959c0147a400/0x133f221c08775bd8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.187756:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c0147a400 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048437.187760:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff959c0147a400/0x133f221c08775bd8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.187768:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff959c0147a400/0x133f221c08775bd8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.187781:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff959c0147a400/0x133f221c08775bd8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048437.187791:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048437.187822:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:3621:x1875953111293184:12345-0@lo:103: Request processed in 197us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048437.187829:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789048437.187856:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111293184:0@lo:103: 00010000:00010000:2.0:1789048437.188535:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff959c0147a400/0x133f221c08775bd8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.188545:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff959c0147a400/0x133f221c08775bd8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048437.188552:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c0147a400/0x133f221c08775bd8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1789048437.199268:0:8405:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789048437.199438:0:8405:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789048437.199593:0:8405:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789048437.199715:0:8405:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789048437.207488:0:8405:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1789048437.208061:0:8405:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1789048437.209646:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789048437.225554:0:8405:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789048437.225564:0:8405:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789048437.225599:0:8405:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789048437.225635:0:8405:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789048437.225654:0:8405:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789048437.225676:0:8405:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1789048437.226641:0:8405:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789048437.226968:0:8405:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1789048437.733118:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789048438.209642:0:8491:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789048438.211450:0:8491:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789048438.752484:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048439.775009:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048439.775364:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d310700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111293312:0@lo:41: 00000100:00100000:3.0:1789048439.775442:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048439.775555:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111293312 00000100:00100000:0.0:1789048439.775564:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111293312 00000100:00100000:0.0:1789048439.775615:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789048439.775624:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111293312:12345-0@lo:41: 00000004:00000024:0.0:1789048439.775659:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1789048439.775718:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111293312:12345-0@lo:41: Request processed in 84us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048439.775725:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789048439.775781:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d310700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111293312:0@lo:41: 00010000:00010000:2.0:1789048440.797579:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048441.310581:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789048441.310616:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111293440:0@lo:41: 00000100:00100000:0.0:1789048441.310683:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048441.310832:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111293440 00000100:00100000:1.0:1789048441.310841:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111293440 00000100:00100000:1.0:1789048441.310892:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789048441.310901:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111293440:12345-0@lo:41: 00000004:00000024:1.0:1789048441.310937:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789048441.310980:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111293440:12345-0@lo:41: Request processed in 81us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048441.310988:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789048441.311064:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111293440:0@lo:41: 00010000:00010000:3.0:1789048441.821541:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048442.334533:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111293952:0@lo:400: 00000100:00100000:1.0:1789048442.334636:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048442.334724:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789048442.334732:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111293568:0@lo:400: 00000100:00100000:1.0:1789048442.334766:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048442.334800:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111294080:0@lo:400: 00000100:00100000:1.0:1789048442.334828:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048442.334857:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111293696:0@lo:400: 00000100:00100000:1.0:1789048442.334879:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048442.334901:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111294208:0@lo:400: 00000100:00100000:1.0:1789048442.334925:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048442.334944:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789048442.334949:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111293824:0@lo:400: 00000100:00100000:1.0:1789048442.334970:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048442.334986:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111294336:0@lo:400: 00000100:00100000:1.0:1789048442.338434:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048442.338530:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111293952 00000100:00100000:1.0:1789048442.338541:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111293952 00000100:00100000:1.0:1789048442.338595:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111293696 00000100:00100000:1.0:1789048442.338598:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111293696 00000100:00100000:1.0:1789048442.338610:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111294208 00000100:00100000:1.0:1789048442.338612:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111294208 00000100:00100000:1.0:1789048442.338650:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111294336 00000100:00100000:1.0:1789048442.338653:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111294336 00000100:00100000:1.0:1789048442.338672:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789048442.338694:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111293952:12345-0@lo:400: 00000100:00100000:1.0:1789048442.338771:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111293952:12345-0@lo:400: Request processed in 89us (4135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048442.338779:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789048442.338799:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789048442.338804:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111293696:12345-0@lo:400: 00000100:00100000:1.0:1789048442.338837:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111293696:12345-0@lo:400: Request processed in 32us (3956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048442.338863:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789048442.338875:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789048442.341399:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789048442.341410:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789048442.341433:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111294080 00000100:00100000:2.0:1789048442.341447:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111294080 00000100:00100000:2.0:1789048442.341499:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111293824 00000100:00100000:2.0:1789048442.341503:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111293824 00000100:00100000:2.0:1789048442.341525:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789048442.341536:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111294080:12345-0@lo:400: 00000100:00100000:2.0:1789048442.341665:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111294080:12345-0@lo:400: Request processed in 131us (6835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048442.341674:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789048442.341706:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789048442.341712:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111293824:12345-0@lo:400: 00000100:00100000:2.0:1789048442.341744:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111293824:12345-0@lo:400: Request processed in 33us (6774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048442.341750:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789048442.342455:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111294208:12345-0@lo:400: 00000100:00100000:1.0:1789048442.342510:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111294208:12345-0@lo:400: Request processed in 66us (7583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048442.351422:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789048442.351443:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789048442.351528:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789048442.351646:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111293568 00000100:00100000:2.0:1789048442.351658:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111293568 00000100:00100000:2.0:1789048442.351733:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789048442.351743:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:3622:x1875953111293568:12345-0@lo:400: 00000100:00100000:2.0:1789048442.351862:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:3622:x1875953111293568:12345-0@lo:400: Request processed in 121us (17094us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048442.351869:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789048442.351930:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111294336:12345-0@lo:400: 00000100:00100000:2.0:1789048442.351973:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111294336:12345-0@lo:400: Request processed in 419us (13549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048442.351980:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789048442.355778:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111293824:0@lo:400: 00010000:00080000:0.0:1789048442.355808:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d83480 x1875953111294336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048442.355821:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111294336:0@lo:400: 00010000:00080000:0.0:1789048442.355837:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d83100 x1875953111293696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048442.355847:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111293696:0@lo:400: 00010000:00080000:0.0:1789048442.355871:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d80380 x1875953111294208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048442.355893:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111294208:0@lo:400: 00000100:00100000:0.0:1789048442.355947:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111293568:0@lo:400: 00000100:00100000:0.0:1789048442.355960:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111294080:0@lo:400: 00010000:00080000:0.0:1789048442.355978:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d82680 x1875953111293952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048442.355987:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111293952:0@lo:400: 00000100:00100000:1.0:1789048442.356311:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1789048442.845491:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048443.869859:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789048444.812691:0:8782:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789048444.893464:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048444.893885:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789048444.893907:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111294464:0@lo:41: 00000100:00100000:3.0:1789048444.893976:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048444.894472:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111294464 00000100:00100000:3.0:1789048444.894490:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111294464 00000100:00100000:3.0:1789048444.894543:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789048444.894553:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111294464:12345-0@lo:41: 00000004:00000024:3.0:1789048444.894587:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1789048444.894639:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111294464:12345-0@lo:41: Request processed in 88us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048444.894646:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789048444.894701:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111294464:0@lo:41: 10000000:01000000:3.0:1789048444.896928:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789048444.896935:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959c414c7000 from 30 10000000:01000000:3.0:1789048444.896940:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789048444.896984:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c0147a400/0x133f221c08775bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048444.897006:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c0147a400/0x133f221c08775bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048444.897017:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c0147a400/0x133f221c08775bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048444.897040:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111294592:0@lo:101: 00000100:00100000:3.0:1789048444.897102:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048444.897140:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c415013c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048444.897160:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111294592 00000100:00100000:3.0:1789048444.897166:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111294592 00000100:00100000:3.0:1789048444.897220:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789048444.897229:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:6494:x1875953111294592:12345-0@lo:101: 00010000:00010000:3.0:1789048444.897242:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048444.897263:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c0147b200/0x133f221c08775be6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775bdf expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048444.897287:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c0147b200/0x133f221c08775be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775bdf expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048444.897299:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c0147b200/0x133f221c08775be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775bdf expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048444.897308:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c0147b200, rc 0) 00000100:00100000:3.0:1789048444.897362:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:6494:x1875953111294592:12345-0@lo:101: Request processed in 134us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048444.897369:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789048444.897411:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111294592:0@lo:101: 00010000:00010000:3.0:1789048444.897425:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c0147a400/0x133f221c08775bdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775be6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048444.897433:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c0147a400/0x133f221c08775bdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775be6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048444.897489:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111294720:0@lo:501: 00000100:00100000:3.0:1789048444.897513:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048444.897533:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c415013c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048444.897545:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111294720 00000100:00100000:3.0:1789048444.897549:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111294720 00000100:00100000:3.0:1789048444.897571:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789048444.897578:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:6494:x1875953111294720:12345-0@lo:501: 00000100:00100000:3.0:1789048444.897699:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:6494:x1875953111294720:12345-0@lo:501: Request processed in 121us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048444.897971:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789048444.898611:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111294720:0@lo:501: 00000100:00100000:3.0:1789048444.898648:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111294848:0@lo:503: 00000100:00100000:3.0:1789048444.900387:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048444.900441:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c415013c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048444.901384:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111294848 00000100:00100000:2.0:1789048444.901396:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111294848 00000100:00100000:2.0:1789048444.901449:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789048444.901458:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:6494:x1875953111294848:12345-0@lo:503: 00000100:00100000:2.0:1789048444.901616:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:6494:x1875953111294848:12345-0@lo:503: Request processed in 159us (2908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048444.901631:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789048444.901755:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111294848:0@lo:503: 00000100:00100000:3.0:1789048444.902512:0:8786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8786:1875953111294976:0@lo:502: 00000100:00100000:3.0:1789048444.902562:0:8786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048444.902603:0:8786:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41501000 going to sleep for 11 seconds 00000100:00100000:1.0:1789048444.902646:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111294976 00000100:00100000:1.0:1789048444.902651:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111294976 00000100:00100000:1.0:1789048444.902699:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789048444.902716:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:8786:x1875953111294976:12345-0@lo:502: 00000100:00100000:1.0:1789048444.902813:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:8786:x1875953111294976:12345-0@lo:502: Request processed in 107us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048444.902935:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789048444.903022:0:8786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8786:1875953111294976:0@lo:502: 00000100:00100000:3.0:1789048444.903060:0:8786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8786:1875953111295104:0@lo:502: 00000100:00100000:3.0:1789048444.903092:0:8786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048444.903118:0:8786:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41501000 going to sleep for 11 seconds 00000100:00100000:1.0:1789048444.903278:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111295104 00000100:00100000:1.0:1789048444.903283:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111295104 00000100:00100000:1.0:1789048444.903315:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789048444.903323:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:8786:x1875953111295104:12345-0@lo:502: 00000100:00100000:1.0:1789048444.903422:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:8786:x1875953111295104:12345-0@lo:502: Request processed in 100us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048444.903429:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789048444.903701:0:8786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8786:1875953111295104:0@lo:502: 00000040:00080000:3.0:1789048444.903734:0:8786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789048444.904090:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789048444.904112:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789048444.904122:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c0147a400/0x133f221c08775bdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775be6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048444.904146:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c0147a400/0x133f221c08775bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775be6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048444.904156:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789048444.904158:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c414c7000 from 5 10000000:01000000:1.0:1789048444.904161:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789048444.904265:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c013d7200/0x133f221c08775bed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048444.904274:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c013d7200/0x133f221c08775bed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048444.904284:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c013d7200/0x133f221c08775bed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048444.904299:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d81500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111295232:0@lo:101: 00000100:00100000:1.0:1789048444.904540:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048444.904574:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2ae92840 going to sleep for 11 seconds 00000100:00100000:3.0:1789048444.904698:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111295232 00000100:00100000:3.0:1789048444.904704:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111295232 00000100:00100000:3.0:1789048444.904756:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789048444.904764:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:6494:x1875953111295232:12345-0@lo:101: 00010000:00010000:3.0:1789048444.904776:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048444.904789:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c0147b800/0x133f221c08775bf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775bed expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048444.904811:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c0147b800/0x133f221c08775bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775bed expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048444.904957:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c0147b800/0x133f221c08775bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775bed expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048444.904965:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c0147b800, rc 0) 00000100:00100000:3.0:1789048444.905157:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:6494:x1875953111295232:12345-0@lo:101: Request processed in 393us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048444.905164:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789048444.918164:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d81500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111295232:0@lo:101: 00010000:00010000:2.0:1789048444.918275:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c013d7200/0x133f221c08775bed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775bf4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048444.918288:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c013d7200/0x133f221c08775bed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775bf4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048444.935836:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111295360:0@lo:256: 00000100:00100000:3.0:1789048444.935922:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048444.935972:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41501840 going to sleep for 11 seconds 00000100:00100000:0.0:1789048444.939529:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111295360 00000100:00100000:0.0:1789048444.939546:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111295360 00000100:00100000:0.0:1789048444.939624:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789048444.939635:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:6494:x1875953111295360:12345-0@lo:256: 20000000:01000000:0.0:1789048444.939672:0:6490:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789048444.939804:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789048444.939809:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789048444.940411:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:6494:x1875953111295360:12345-0@lo:256: Request processed in 775us (4485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048444.940420:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789048444.951958:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111295360:0@lo:256: 10000000:01000000:2.0:1789048444.952996:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789048444.953009:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c013d7200/0x133f221c08775bed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775bf4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048444.953020:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c013d7200/0x133f221c08775bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775bf4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048444.953030:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789048444.953033:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1789048444.953043:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789048444.953078:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775bfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048444.953086:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775bfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048444.953097:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775bfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048444.953115:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111295488:0@lo:101: 00000100:00100000:2.0:1789048444.953186:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048444.953237:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa6000 going to sleep for 11 seconds 00000100:00100000:3.0:1789048444.953489:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111295488 00000100:00100000:3.0:1789048444.953497:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111295488 00000100:00100000:3.0:1789048444.953551:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789048444.953561:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:6494:x1875953111295488:12345-0@lo:101: 00010000:00010000:3.0:1789048444.953574:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048444.953586:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c0147ba00/0x133f221c08775c02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775bfb expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048444.953609:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c0147ba00/0x133f221c08775c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775bfb expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048444.953620:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c0147ba00/0x133f221c08775c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775bfb expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048444.953628:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c0147ba00, rc 0) 00000100:00100000:3.0:1789048444.953686:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111295488:12345-0@lo:101: Request processed in 126us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048444.953699:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789048444.953786:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111295488:0@lo:101: 00010000:00010000:0.0:1789048444.953799:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775bfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775c02 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048444.953809:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775bfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775c02 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048444.953877:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d313480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111295616:0@lo:501: 00000100:00100000:0.0:1789048444.953905:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048444.953935:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef3e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048444.954271:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111295616 00000100:00100000:2.0:1789048444.954277:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111295616 00000100:00100000:2.0:1789048444.954363:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789048444.954371:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111295616:12345-0@lo:501: 00000100:00100000:2.0:1789048444.954494:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111295616:12345-0@lo:501: Request processed in 124us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048444.954501:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789048444.966460:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d313480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111295616:0@lo:501: 00000100:00100000:2.0:1789048444.966524:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111295744:0@lo:503: 00000100:00100000:2.0:1789048444.966599:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048444.966648:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048444.966680:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111295744 00000100:00100000:2.0:1789048444.966687:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111295744 00000100:00100000:2.0:1789048444.968005:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789048444.968019:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111295744:12345-0@lo:503: 00000100:00100000:0.0:1789048444.969086:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111295744:0@lo:503: 00000100:00100000:2.0:1789048444.970584:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111295744:12345-0@lo:503: Request processed in 2560us (3976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048444.970599:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789048444.972107:0:8789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8789:1875953111295872:0@lo:502: 00000100:00100000:3.0:1789048444.972198:0:8789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048444.972245:0:8789:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41501900 going to sleep for 11 seconds 00000100:00100000:0.0:1789048444.972295:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111295872 00000100:00100000:0.0:1789048444.972303:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111295872 00000100:00100000:0.0:1789048444.972367:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789048444.972376:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:8789:x1875953111295872:12345-0@lo:502: 00000100:00100000:0.0:1789048444.972498:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:8789:x1875953111295872:12345-0@lo:502: Request processed in 122us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048444.972506:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789048444.973377:0:8789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8789:1875953111295872:0@lo:502: 00000020:01000000:2.0:1789048444.973417:0:8789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789048444.973426:0:8789:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789048444.973433:0:8789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048444.973436:0:8789:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789048444.973441:0:8789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789048444.973445:0:8789:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:2.0:1789048444.973468:0:8789:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789048444.973479:0:8789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789048444.973494:0:8789:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff959c3ef7b380) 00000020:00000080:2.0:1789048444.973515:0:8789:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1789048444.973523:0:8789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789048444.973606:0:8789:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1789048444.973613:0:8789:0:(osd_handler.c:8921:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789048444.973620:0:8789:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x133f221c08775c10 00010000:00080000:2.0:1789048444.973649:0:8789:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959b0683b000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:2.0:1789048444.974404:0:8789:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789048445.014064:0:8789:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789048445.014097:0:8789:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789048445.014389:0:8789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789048445.014633:0:8789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789048445.014734:0:8789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789048445.014855:0:8789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789048445.016471:0:8791:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789048445.016480:0:8791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789048445.019017:0:8789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789048445.019039:0:8789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789048445.019097:0:8789:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789048445.019128:0:8789:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x133f221c08775c17 00000100:00080000:3.0:1789048445.019141:0:8789:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789048445.019156:0:8789:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff959b0683b000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048445.019201:0:8789:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b05d8aa00 x1875953111296000/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789048445.019239:0:8789:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789048445.019417:0:8789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048445.019422:0:8789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048445.019425:0:8789:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789048445.019428:0:8789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048445.019434:0:8789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048445.019435:0:8789:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789048445.019439:0:8789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789048445.019441:0:8789:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789048445.019475:0:8789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d8b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8789:1875953111296128:0@lo:502: 00000100:00100000:3.0:1789048445.019590:0:8789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048445.019666:0:8789:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41501a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789048445.019901:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111296000:0@lo:8: 00000100:00100000:1.0:1789048445.019945:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048445.020193:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111296000 00000100:00100000:3.0:1789048445.020201:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111296000 00000100:00100000:3.0:1789048445.020247:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789048445.020255:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3619:x1875953111296000:12345-0@lo:8: 00010000:00080000:3.0:1789048445.020292:0:8412:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:3.0:1789048445.020321:0:8412:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x133f221c08775c1e 00002000:00100000:3.0:1789048445.020380:0:8412:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff959c416dc800 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789048445.020386:0:8412:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1789048445.020390:0:8412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789048445.020476:0:8412:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789048445.020852:0:8412:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789048445.020888:0:8412:0:(import.c:65:import_set_state_nolock()) ffff959c416dd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789048445.021010:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1875953111296000:12345-0@lo:8: Request processed in 754us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048445.021020:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789048445.021238:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111296384:0@lo:400: 00000100:00100000:2.0:1789048445.021263:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111296128 00000100:00100000:2.0:1789048445.021270:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111296128 00000100:00100000:0.0:1789048445.021277:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048445.021307:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789048445.021309:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789048445.021313:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111296512:0@lo:400: 00000100:00100000:2.0:1789048445.021317:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:8789:x1875953111296128:12345-0@lo:502: 00000100:00100000:0.0:1789048445.021365:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048445.021394:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111296512 00000100:00100000:0.0:1789048445.021397:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111296512 00000100:00100000:0.0:1789048445.021426:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789048445.021432:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111296512:12345-0@lo:400: 00000100:00100000:0.0:1789048445.021472:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111296512:12345-0@lo:400: Request processed in 41us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048445.021476:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:8789:x1875953111296128:12345-0@lo:502: Request processed in 160us (1887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048445.021479:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789048445.021482:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789048445.021521:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111296512:0@lo:400: 00000100:00100000:2.0:1789048445.021592:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111296640:0@lo:400: 00000100:00100000:2.0:1789048445.021688:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048445.021716:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789048445.021722:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111296256:0@lo:400: 00000100:00100000:2.0:1789048445.021744:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048445.021763:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111296768:0@lo:400: 00000100:00100000:0.0:1789048445.021778:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111296384 00000100:00100000:0.0:1789048445.021782:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111296384 00000100:00100000:2.0:1789048445.021784:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048445.021804:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111296640 00000100:00100000:0.0:1789048445.021806:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111296640 00000100:00100000:2.0:1789048445.021828:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111296256 00000100:00100000:0.0:1789048445.021828:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111296768 00000100:00100000:2.0:1789048445.021830:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111296256 00000100:00100000:0.0:1789048445.021830:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111296768 00000100:00100000:0.0:1789048445.021844:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789048445.021850:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111296384:12345-0@lo:400: 00000100:00100000:0.0:1789048445.021886:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111296384:12345-0@lo:400: Request processed in 36us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048445.021924:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789048445.021934:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111296640:12345-0@lo:400: 00000100:00100000:2.0:1789048445.021970:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111296640:12345-0@lo:400: Request processed in 40us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048445.021976:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789048445.021988:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789048445.021994:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111296768:12345-0@lo:400: 00000100:00100000:2.0:1789048445.022029:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111296768:12345-0@lo:400: Request processed in 35us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048445.022035:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789048445.022045:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789048445.022050:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111296256:12345-0@lo:400: 00000100:00100000:2.0:1789048445.022075:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111296256:12345-0@lo:400: Request processed in 25us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048445.022080:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1789048445.022130:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d75f80 x1875953111296256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048445.022142:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111296256:0@lo:400: 00010000:00080000:2.0:1789048445.022153:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d77b80 x1875953111296768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048445.022160:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111296768:0@lo:400: 00010000:00080000:2.0:1789048445.022170:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d75c00 x1875953111296640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048445.022189:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111296640:0@lo:400: 00000100:00100000:0.0:1789048445.022286:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1789048445.022307:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789048445.022311:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789048445.022328:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d74e00 x1875953111296384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048445.022495:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111296384:0@lo:400: 00000100:00100000:2.0:1789048445.022503:0:8789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d8b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8789:1875953111296128:0@lo:502: 00000020:01000000:2.0:1789048445.022593:0:8789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789048445.022600:0:8789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048445.022603:0:8789:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789048445.022608:0:8789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1789048445.022966:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1789048445.022992:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789048445.023011:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775bfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775c02 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048445.023024:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775c02 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048445.023036:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789048445.023039:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959c335d0800 from 30 10000000:01000000:0.0:1789048445.023043:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789048445.023077:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00031a00/0x133f221c08775c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048445.023085:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c00031a00/0x133f221c08775c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048445.023094:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c00031a00/0x133f221c08775c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048445.023110:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111296896:0@lo:101: 00000100:00100000:0.0:1789048445.023229:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048445.023266:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef3e240 going to sleep for 11 seconds 00000100:00100000:2.0:1789048445.023308:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111296896 00000100:00100000:2.0:1789048445.023315:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111296896 00000100:00100000:2.0:1789048445.023372:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789048445.023381:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111296896:12345-0@lo:101: 00010000:00010000:2.0:1789048445.023393:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048445.023407:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c02837c00/0x133f221c08775c2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775c25 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048445.023431:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c02837c00/0x133f221c08775c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775c25 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048445.023442:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c02837c00/0x133f221c08775c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775c25 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048445.023451:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02837c00, rc 0) 00000100:00100000:2.0:1789048445.023485:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111296896:12345-0@lo:101: Request processed in 105us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048445.023492:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:1.0:1789048445.023948:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d8aa00 x1875953111296000/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789048455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048445.023962:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789048445.023972:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789048445.023983:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:1.0:1789048445.023997:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789048445.024002:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b0683b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789048445.024021:0:3619:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789048445.024029:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111296000:0@lo:8: 00000004:00080000:1.0:1789048445.024084:0:8791:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789048445.024321:0:8791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 199777986829ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789048445.024354:0:8791:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789048445.024809:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111296896:0@lo:101: 00010000:00010000:2.0:1789048445.024832:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c00031a00/0x133f221c08775c25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775c2c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048445.024856:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c00031a00/0x133f221c08775c25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775c2c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048445.024933:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111297024:0@lo:501: 00000100:00100000:2.0:1789048445.024979:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048445.025017:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048445.025069:0:8793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8793:1875953111297152:0@lo:700: 00000100:00100000:0.0:1789048445.025096:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111297024 00000100:00100000:0.0:1789048445.025103:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111297024 00000100:00100000:2.0:1789048445.025131:0:8793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048445.025151:0:8793:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789048445.025205:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789048445.025217:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111297024:12345-0@lo:501: 00000100:00100000:3.0:1789048445.025239:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111297152 00000100:00100000:3.0:1789048445.025245:0:8420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111297152 00000100:00100000:3.0:1789048445.025286:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789048445.025418:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111297024:12345-0@lo:501: Request processed in 204us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048445.025426:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789048445.025455:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111297024:0@lo:501: 00000100:00080000:0.0:1789048445.025459:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048445.025484:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111297280:0@lo:503: 00000100:00100000:2.0:1789048445.025602:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048445.025620:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048445.025635:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111297280 00000100:00100000:0.0:1789048445.025646:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111297280 00000100:00100000:0.0:1789048445.025689:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789048445.025696:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111297280:12345-0@lo:503: 00000100:00100000:0.0:1789048445.025793:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111297280:12345-0@lo:503: Request processed in 97us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048445.025801:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789048445.025838:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111297280:0@lo:503: 00000100:00100000:1.0:1789048445.026202:0:8794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8794:1875953111297408:0@lo:502: 00000100:00100000:1.0:1789048445.026242:0:8794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048445.026268:0:8794:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2ae92c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789048445.026848:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111297408 00000100:00100000:2.0:1789048445.026854:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111297408 00000100:00100000:2.0:1789048445.026898:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789048445.026909:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:8794:x1875953111297408:12345-0@lo:502: 00000100:00100000:3.0:1789048445.026959:0:8420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8793:x1875953111297152:12345-0@lo:700: 00000100:00100000:3.0:1789048445.026999:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d88700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8420:1875953111297536:0@lo:700: 00000100:00100000:2.0:1789048445.027023:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:8794:x1875953111297408:12345-0@lo:502: Request processed in 117us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048445.027031:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789048445.027040:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048445.027058:0:8794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8794:1875953111297408:0@lo:502: 00000100:00100000:3.0:1789048445.027061:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41501180 going to sleep for 11 seconds 00000100:00100000:1.0:1789048445.027112:0:8794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8794:1875953111297664:0@lo:502: 00000100:00100000:0.0:1789048445.027194:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111297536 00000100:00100000:0.0:1789048445.027198:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111297536 00000100:00100000:1.0:1789048445.027227:0:8794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048445.027244:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789048445.027255:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8420:x1875953111297536:12345-0@lo:700: 00000100:00100000:1.0:1789048445.027260:0:8794:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2ae92c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789048445.027381:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111297664 00000100:00100000:1.0:1789048445.027386:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111297664 00000100:00100000:1.0:1789048445.027429:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789048445.027439:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:8794:x1875953111297664:12345-0@lo:502: 00000100:00100000:1.0:1789048445.027565:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:8794:x1875953111297664:12345-0@lo:502: Request processed in 128us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048445.027572:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789048445.027630:0:8794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8794:1875953111297664:0@lo:502: 00000040:00080000:0.0:1789048445.027652:0:8794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789048445.027740:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789048445.027767:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789048445.027778:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00031a00/0x133f221c08775c25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775c2c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048445.027795:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c00031a00/0x133f221c08775c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775c2c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048445.027804:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789048445.027806:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c335d0800 from 5 10000000:01000000:2.0:1789048445.027808:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789048445.027836:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775c33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048445.027841:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775c33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048445.027849:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775c33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048445.027858:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111297792:0@lo:101: 00000100:00100000:2.0:1789048445.027882:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048445.027902:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa6000 going to sleep for 11 seconds 00000100:00100000:0.0:1789048445.027915:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111297792 00000100:00100000:0.0:1789048445.027921:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111297792 00000100:00100000:2.0:1789048445.027954:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789048445.027962:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111297792:12345-0@lo:101: 00010000:00010000:2.0:1789048445.027970:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048445.027981:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c02837400/0x133f221c08775c3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775c33 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048445.028001:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c02837400/0x133f221c08775c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775c33 expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048445.028008:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c02837400/0x133f221c08775c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775c33 expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048445.028022:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02837400, rc 0) 00000100:00100000:2.0:1789048445.028046:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:6494:x1875953111297792:12345-0@lo:101: Request processed in 86us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048445.028052:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789048445.028071:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111297792:0@lo:101: 00010000:00010000:0.0:1789048445.028087:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775c33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775c3a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048445.028098:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775c33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775c3a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048445.028219:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111297920:0@lo:256: 00000100:00100000:0.0:1789048445.028255:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048445.028315:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef3e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789048445.028405:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111297920 00000100:00100000:1.0:1789048445.028410:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111297920 00000100:00100000:1.0:1789048445.028444:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789048445.028451:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:6494:x1875953111297920:12345-0@lo:256: 20000000:01000000:1.0:1789048445.028466:0:6492:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789048445.028490:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789048445.028493:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789048445.028587:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:6494:x1875953111297920:12345-0@lo:256: Request processed in 135us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048445.028595:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789048445.028598:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111297920:0@lo:256: 10000000:01000000:0.0:1789048445.028641:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789048445.028647:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775c3a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048445.028674:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775c3a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048445.028683:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789048445.028686:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1789048445.028689:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789048445.028706:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775c41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048445.028712:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775c41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048445.028717:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775c41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048445.028724:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111298048:0@lo:101: 00000100:00100000:0.0:1789048445.028742:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048445.028771:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef3e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789048445.028813:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111298048 00000100:00100000:1.0:1789048445.028817:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111298048 00000100:00100000:1.0:1789048445.028870:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789048445.028875:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:6494:x1875953111298048:12345-0@lo:101: 00010000:00010000:1.0:1789048445.028881:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048445.028889:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c013d7a00/0x133f221c08775c48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775c41 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048445.028900:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c013d7a00/0x133f221c08775c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775c41 expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048445.028906:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c013d7a00/0x133f221c08775c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775c41 expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048445.028912:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c013d7a00, rc 0) 00000100:00100000:1.0:1789048445.028932:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:6494:x1875953111298048:12345-0@lo:101: Request processed in 58us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048445.028935:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789048445.028970:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111298048:0@lo:101: 00010000:00010000:0.0:1789048445.028978:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775c41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775c48 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048445.028984:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775c41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775c48 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048445.029026:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111298176:0@lo:501: 00000100:00100000:0.0:1789048445.029053:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048445.029085:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef3e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789048445.029113:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111298176 00000100:00100000:1.0:1789048445.029117:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111298176 00000100:00100000:1.0:1789048445.029143:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789048445.029149:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:6494:x1875953111298176:12345-0@lo:501: 00000100:00100000:1.0:1789048445.029276:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:6494:x1875953111298176:12345-0@lo:501: Request processed in 127us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048445.029292:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789048445.029383:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111298176:0@lo:501: 00000100:00100000:0.0:1789048445.029411:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111298304:0@lo:503: 00000100:00100000:0.0:1789048445.029452:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048445.029471:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef3e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789048445.029522:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111298304 00000100:00100000:1.0:1789048445.029527:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111298304 00000100:00100000:1.0:1789048445.029582:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789048445.029591:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:6494:x1875953111298304:12345-0@lo:503: 00000100:00100000:1.0:1789048445.029684:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:6494:x1875953111298304:12345-0@lo:503: Request processed in 94us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048445.029691:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000004:00080000:2.0:1789048445.029721:0:7428:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789048445.029753:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111298304:0@lo:503: 00000100:00100000:3.0:1789048445.032322:0:8796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8796:1875953111298432:0@lo:502: 00000100:00100000:3.0:1789048445.032509:0:8796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048445.032597:0:8796:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41501c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789048445.035738:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111298432 00000100:00100000:1.0:1789048445.035757:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111298432 00000100:00100000:1.0:1789048445.035837:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789048445.035850:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:8796:x1875953111298432:12345-0@lo:502: 00000100:00100000:1.0:1789048445.036083:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:8796:x1875953111298432:12345-0@lo:502: Request processed in 236us (3574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048445.036093:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789048445.036224:0:8796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8796:1875953111298432:0@lo:502: 00000020:01000000:3.0:1789048445.036272:0:8796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789048445.036282:0:8796:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789048445.036291:0:8796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048445.036294:0:8796:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789048445.036308:0:8796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789048445.036312:0:8796:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:3.0:1789048445.036383:0:8796:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789048445.036387:0:8796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789048445.036409:0:8796:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff959c03e419c0) 00000020:00000080:3.0:1789048445.036435:0:8796:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1789048445.036442:0:8796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789048445.036567:0:8796:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789048445.036577:0:8796:0:(osd_handler.c:8921:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789048445.036586:0:8796:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c08775c56 00010000:00080000:3.0:1789048445.036639:0:8796:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959b06839800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:3.0:1789048445.036951:0:8796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 40000000:02000000:1.0:1789048445.037879:0:6504:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1789048445.042949:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8420:x1875953111297536:12345-0@lo:700: Request processed in 15686us (15899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048445.042967:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789048445.043095:0:8420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d88700 x1875953111297536/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789048461 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048445.043113:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d88700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8420:1875953111297536:0@lo:700: 40000000:02000000:1.0:1789048445.043132:0:8420:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:3.0:1789048445.045768:0:8796:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789048445.045801:0:8796:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789048445.046091:0:8796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789048445.046316:0:8796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789048445.046494:0:8796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789048445.046593:0:8796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789048445.047676:0:8800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789048445.047683:0:8800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789048445.048427:0:8796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789048445.048444:0:8796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789048445.048488:0:8796:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789048445.048515:0:8796:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x133f221c08775c5d 00000100:00080000:0.0:1789048445.048529:0:8796:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789048445.048544:0:8796:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff959b06839800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048445.048588:0:8796:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3d311500 x1875953111298560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048445.048645:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111298560:0@lo:8: 00000100:00100000:3.0:1789048445.048741:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789048445.048814:0:8796:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789048445.048879:0:8796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048445.048883:0:8796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048445.048885:0:8796:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789048445.048888:0:8796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048445.048892:0:8796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048445.048893:0:8796:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789048445.048895:0:8796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789048445.048897:0:8796:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789048445.048924:0:8796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8796:1875953111298688:0@lo:502: 00000100:00100000:0.0:1789048445.048975:0:8796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048445.049001:0:8796:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef3e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789048445.049047:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111298688 00000100:00100000:0.0:1789048445.049054:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111298688 00000100:00100000:0.0:1789048445.049105:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789048445.049114:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:8796:x1875953111298688:12345-0@lo:502: 00000100:00100000:0.0:1789048445.049242:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:8796:x1875953111298688:12345-0@lo:502: Request processed in 128us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048445.049250:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789048445.049302:0:8796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:8796:1875953111298688:0@lo:502: 00000020:01000000:0.0:1789048445.049326:0:8796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048445.049330:0:8796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048445.049352:0:8796:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789048445.049357:0:8796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1789048445.049421:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789048445.049446:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789048445.049459:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775c41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775c48 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048445.049471:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775c48 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048445.049481:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789048445.049484:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff959c394bb380 from 1 10000000:01000000:2.0:1789048445.049488:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789048445.049517:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775c64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048445.049526:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775c64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048445.049537:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775c64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048445.049550:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111298816:0@lo:101: 00000100:00100000:2.0:1789048445.049580:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048445.049611:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa6300 going to sleep for 11 seconds 00000100:00100000:0.0:1789048445.050460:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111298816 00000100:00100000:0.0:1789048445.050468:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111298816 00000100:00100000:0.0:1789048445.050509:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789048445.050518:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:6494:x1875953111298816:12345-0@lo:101: 00010000:00010000:0.0:1789048445.050534:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048445.050551:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c00030a00/0x133f221c08775c6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775c64 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048445.050582:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c00030a00/0x133f221c08775c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775c64 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048445.050595:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c00030a00/0x133f221c08775c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775c64 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048445.050605:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c00030a00, rc 0) 00000100:00100000:0.0:1789048445.050681:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111298816:12345-0@lo:101: Request processed in 164us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048445.050694:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789048445.050782:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111298816:0@lo:101: 00010000:00010000:3.0:1789048445.050800:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775c64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775c6b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048445.050811:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775c64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775c6b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048445.050888:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d8aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111298944:0@lo:501: 00000100:00100000:3.0:1789048445.050925:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048445.050988:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41501d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789048445.051019:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111298944 00000100:00100000:0.0:1789048445.051024:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111298944 00000100:00100000:0.0:1789048445.051045:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789048445.051051:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111298944:12345-0@lo:501: 00000100:00100000:0.0:1789048445.051159:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111298944:12345-0@lo:501: Request processed in 107us (232us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789048445.051166:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789048445.051214:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d8aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111298944:0@lo:501: 10000000:01000000:3.0:1789048445.051242:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789048445.051249:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775c64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775c6b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048445.051258:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775c6b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048445.051401:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111298560 00000100:00100000:0.0:1789048445.051408:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111298560 00000100:00100000:0.0:1789048445.051437:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789048445.051443:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3619:x1875953111298560:12345-0@lo:8: 00010000:00080000:0.0:1789048445.051471:0:8414:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:0.0:1789048445.051511:0:8414:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x133f221c08775c72 00002000:00100000:0.0:1789048445.051528:0:8414:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff959b05da0800 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789048445.051535:0:8414:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789048445.051539:0:8414:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789048445.051639:0:8414:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789048445.051686:0:8414:0:(import.c:65:import_set_state_nolock()) ffff959b05da5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789048445.051738:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3619:x1875953111298560:12345-0@lo:8: Request processed in 293us (2997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048445.051745:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789048445.051787:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3d311500 x1875953111298560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789048455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048445.051798:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789048445.051806:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789048445.051821:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:0.0:1789048445.051828:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789048445.051831:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b06839800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789048445.051847:0:3619:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789048445.051852:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111298560:0@lo:8: 00000004:00080000:3.0:1789048445.051950:0:8800:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789048445.052007:0:8800:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 199805673245ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789048445.052014:0:8800:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000001:00100000:2.0:1789048445.056404:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789048445.056418:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789048445.057566:0:8420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8793:x1875953111297152:12345-0@lo:700: Request processed in 32266us (32427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048445.057581:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789048445.058016:0:8793:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d77b80 x1875953111297152/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789048461 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048445.058032:0:8793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8793:1875953111297152:0@lo:700: 00000004:00080000:1.0:1789048445.062190:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789048445.062674:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111299072:0@lo:13: 00000100:00100000:3.0:1789048445.062953:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048445.063094:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111299072 00000100:00100000:1.0:1789048445.063103:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111299072 00000100:00100000:1.0:1789048445.063169:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789048445.063179:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111299072:12345-0@lo:13: 00002000:00000024:1.0:1789048445.063209:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789048445.063319:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111299072:12345-0@lo:13: Request processed in 141us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048445.063327:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789048445.063527:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d77100 x1875953111299072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048445.063550:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111299072:0@lo:13: 00000100:00080000:3.0:1789048445.063629:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789048445.064183:0:8801:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789048445.064235:0:8801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8801:1875953111299200:0@lo:7: 00000100:00100000:2.0:1789048445.064314:0:8801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048445.064377:0:8801:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa6300 going to sleep for 11 seconds 00000100:00100000:3.0:1789048445.064735:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111299200 00000100:00100000:3.0:1789048445.064746:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111299200 00000100:00100000:3.0:1789048445.064802:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789048445.064812:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8801:x1875953111299200:12345-0@lo:7: 00000004:00080000:1.0:1789048445.065857:0:8793:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789048445.065961:0:8793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d80700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8793:1875953111299456:0@lo:7: 00000100:00100000:1.0:1789048445.066025:0:8793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048445.066070:0:8793:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c39495f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789048445.066097:0:8413:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789048445.066104:0:8413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789048445.066192:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111299328:0@lo:13: 00000100:00100000:1.0:1789048445.066219:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048445.066252:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111299328 00000100:00100000:1.0:1789048445.066257:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111299328 00000100:00100000:1.0:1789048445.066289:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789048445.066296:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111299328:12345-0@lo:13: 00002000:00000024:1.0:1789048445.066313:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789048445.067069:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111299328:12345-0@lo:13: Request processed in 770us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048445.067079:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789048445.067152:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d82300 x1875953111299328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048445.067176:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111299328:0@lo:13: 00000100:00100000:1.0:1789048445.067221:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111299456 00000100:00100000:1.0:1789048445.067226:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111299456 00000100:00100000:1.0:1789048445.067390:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789048445.067407:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8793:x1875953111299456:12345-0@lo:7: 00002000:00080000:2.0:1789048445.084934:0:8804:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1789048445.084975:0:8804:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789048445.085118:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8793:x1875953111299456:12345-0@lo:7: Request processed in 17713us (19086us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048445.085135:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789048445.086077:0:8793:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d80700 x1875953111299456/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789048461 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048445.086097:0:8793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d80700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8793:1875953111299456:0@lo:7: 00000004:00080000:0.0:1789048445.086113:0:8793:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789048445.086164:0:8793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8793:1875953111299584:0@lo:5: 00000100:00100000:0.0:1789048445.086228:0:8793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048445.086288:0:8793:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef3e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789048445.086439:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111299584 00000100:00100000:1.0:1789048445.086447:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111299584 00000100:00100000:1.0:1789048445.086499:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789048445.086512:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d312a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8793:x1875953111299584:12345-0@lo:5: 00002000:00080000:1.0:1789048445.086539:0:8413:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1789048445.086584:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d312a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8793:x1875953111299584:12345-0@lo:5: Request processed in 76us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048445.086592:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00002000:00080000:2.0:1789048445.087083:0:8412:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789048445.087094:0:8412:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789048445.087175:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8801:x1875953111299200:12345-0@lo:7: Request processed in 22362us (22857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048445.087185:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789048445.087257:0:8801:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d77100 x1875953111299200/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789048461 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048445.087272:0:8801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8801:1875953111299200:0@lo:7: 00000004:00080000:2.0:1789048445.087287:0:8801:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789048445.087327:0:8801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8801:1875953111299712:0@lo:5: 00000100:00100000:2.0:1789048445.087386:0:8801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048445.087411:0:8801:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa6300 going to sleep for 11 seconds 00000100:00100000:2.0:1789048445.087431:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111299712 00000100:00100000:2.0:1789048445.087438:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111299712 00000100:00100000:2.0:1789048445.087476:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789048445.087489:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8801:x1875953111299712:12345-0@lo:5: 00010000:00080000:1.0:1789048445.087531:0:8793:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3d311500 x1875953111299584/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789048461 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048445.087545:0:8793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8793:1875953111299584:0@lo:5: 00000004:00080000:1.0:1789048445.087556:0:8793:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789048445.087588:0:8793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d82300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8793:1875953111299840:0@lo:5: 00002000:00080000:2.0:1789048445.087618:0:8804:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789048445.087625:0:8804:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789048445.087632:0:8793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048445.087670:0:8793:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c39495cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048445.087687:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111299840 00000100:00100000:1.0:1789048445.087693:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111299840 00000100:00100000:2.0:1789048445.087974:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8801:x1875953111299712:12345-0@lo:5: Request processed in 489us (586us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789048445.087982:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789048445.088032:0:8801:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d77100 x1875953111299712/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789048461 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048445.088046:0:8801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8801:1875953111299712:0@lo:5: 00000004:00080000:2.0:1789048445.088057:0:8801:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789048445.088087:0:8801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8801:1875953111299968:0@lo:700: 00000100:00100000:2.0:1789048445.088116:0:8801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048445.088146:0:8801:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa6300 going to sleep for 11 seconds 00000100:00100000:0.0:1789048445.088190:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111299968 00000100:00100000:0.0:1789048445.088197:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111299968 00000100:00100000:0.0:1789048445.088243:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789048445.088252:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8801:x1875953111299968:12345-0@lo:700: 00000100:00100000:1.0:1789048445.088510:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789048445.088520:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8793:x1875953111299840:12345-0@lo:5: 00002000:00080000:1.0:1789048445.088564:0:8413:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1789048445.102750:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8793:x1875953111299840:12345-0@lo:5: Request processed in 14226us (15113us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789048445.102763:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789048445.103113:0:8793:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d82300 x1875953111299840/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789048461 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048445.103132:0:8793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d82300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8793:1875953111299840:0@lo:5: 00000004:00080000:3.0:1789048445.103146:0:8793:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1789048445.103197:0:8793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d8b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8793:1875953111300096:0@lo:900: 00000100:00100000:3.0:1789048445.103234:0:8793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048445.103270:0:8793:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c415013c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048445.103396:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111300096 00000100:00100000:2.0:1789048445.103405:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111300096 00000100:00100000:2.0:1789048445.103447:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789048445.103455:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8793:x1875953111300096:12345-0@lo:900: 00000100:00100000:2.0:1789048445.103505:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8793:x1875953111300096:12345-0@lo:900: Request processed in 51us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048445.103512:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789048445.105672:0:8793:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d8b480 x1875953111300096/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789048461 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048445.105691:0:8793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d8b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8793:1875953111300096:0@lo:900: 00000001:00080000:0.0:1789048445.115826:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:0.0:1789048445.115844:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:0.0:1789048445.119778:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8801:x1875953111299968:12345-0@lo:700: Request processed in 31519us (31651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048445.119790:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789048445.123592:0:8801:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d75c00 x1875953111299968/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789048461 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048445.123607:0:8801:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789048445.123622:0:8801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8801:1875953111299968:0@lo:700: 00000004:02000040:1.0:1789048445.133224:0:8801:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1789048445.136592:0:8801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d80a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8801:1875953111300224:0@lo:5: 00000100:00100000:1.0:1789048445.137854:0:8801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048445.137934:0:8801:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c39495780 going to sleep for 11 seconds 00000100:00100000:2.0:1789048445.139844:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111300224 00000100:00100000:2.0:1789048445.139868:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111300224 00000100:00100000:2.0:1789048445.139929:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789048445.139938:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8801:x1875953111300224:12345-0@lo:5: 00002000:00080000:2.0:1789048445.153630:0:8804:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789048445.156961:0:8804:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1789048445.164738:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8801:x1875953111300224:12345-0@lo:5: Request processed in 24795us (28075us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789048445.164752:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789048445.173074:0:8801:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d80a80 x1875953111300224/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789048461 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048445.173096:0:8801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d80a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8801:1875953111300224:0@lo:5: 00000004:00080000:2.0:1789048445.173114:0:8801:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000020:00000004:3.0:1789048445.818618:0:8843:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789048445.818838:0:8843:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789048445.921689:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048446.431876:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111300352:0@lo:41: 00000100:00100000:2.0:1789048446.431972:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048446.432706:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111300352 00000100:00100000:3.0:1789048446.432720:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111300352 00000100:00100000:3.0:1789048446.432789:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789048446.432803:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111300352:12345-0@lo:41: 00000004:00000024:3.0:1789048446.432867:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789048446.433070:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111300352:12345-0@lo:41: Request processed in 269us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048446.433080:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789048446.433110:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111300352:0@lo:41: 00000001:00080000:1.0:1789048446.900261:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:1.0:1789048446.941938:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048447.965471:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048448.993479:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789048449.259925:0:8944:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789048449.260131:0:8944:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789048450.013791:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048450.013807:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789048450.013836:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111300480:0@lo:41: 00000100:00100000:1.0:1789048450.013932:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048450.014016:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111300480 00000100:00100000:1.0:1789048450.014025:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111300480 00000100:00100000:1.0:1789048450.014085:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789048450.014096:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111300480:12345-0@lo:41: 00000004:00000024:1.0:1789048450.014144:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789048450.014200:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111300480:12345-0@lo:41: Request processed in 104us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048450.014222:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789048450.014284:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111300480:0@lo:41: 00000020:00000004:2.0:1789048450.345575:0:8992:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789048450.345590:0:8992:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1789048450.526141:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789048450.526164:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111300608:0@lo:13: 00000100:00100000:1.0:1789048450.526235:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048450.526300:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111300608 00000100:00100000:1.0:1789048450.526308:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111300608 00000100:00100000:1.0:1789048450.526385:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789048450.526396:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111300608:12345-0@lo:13: 00002000:00000024:1.0:1789048450.526451:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048450.526498:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111300608:12345-0@lo:13: Request processed in 105us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048450.526506:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789048450.526531:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789048450.526622:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c2b611880 x1875953111300608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048450.526632:0:3621:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789048450.526654:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111300608:0@lo:13: 00000100:00100000:1.0:1789048450.527184:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111301120:0@lo:400: 00000100:00100000:1.0:1789048450.527217:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048450.527242:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111301632:0@lo:400: 00000100:00100000:1.0:1789048450.527263:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048450.527292:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789048450.527297:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111300736:0@lo:400: 00000100:00100000:1.0:1789048450.527324:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048450.527380:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111301248:0@lo:400: 00000100:00100000:1.0:1789048450.527406:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048450.527432:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111300864:0@lo:400: 00000100:00100000:1.0:1789048450.527455:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048450.527472:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111301376:0@lo:400: 00000100:00100000:1.0:1789048450.527507:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048450.527526:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789048450.527531:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111300992:0@lo:400: 00000100:00100000:1.0:1789048450.527552:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048450.527569:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111301504:0@lo:400: 00000100:00100000:1.0:1789048450.527588:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048450.527630:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111301120 00000100:00100000:1.0:1789048450.527636:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111301120 00000100:00100000:1.0:1789048450.527662:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111300864 00000100:00100000:1.0:1789048450.527665:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111300864 00000100:00100000:1.0:1789048450.527676:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111301376 00000100:00100000:1.0:1789048450.527678:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111301376 00000100:00100000:1.0:1789048450.527699:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111301504 00000100:00100000:1.0:1789048450.527702:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111301504 00000100:00100000:1.0:1789048450.527716:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789048450.527724:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111301120:12345-0@lo:400: 00000100:00100000:1.0:1789048450.527766:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111301120:12345-0@lo:400: Request processed in 42us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048450.527772:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789048450.527789:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789048450.527795:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111300864:12345-0@lo:400: 00000100:00100000:1.0:1789048450.527826:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111300864:12345-0@lo:400: Request processed in 31us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048450.527839:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789048450.527853:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789048450.527859:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111301376:12345-0@lo:400: 00000100:00100000:1.0:1789048450.527886:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111301376:12345-0@lo:400: Request processed in 28us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048450.527892:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789048450.527903:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789048450.527908:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111301504:12345-0@lo:400: 00000100:00100000:1.0:1789048450.527936:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111301504:12345-0@lo:400: Request processed in 28us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048450.527941:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789048450.527959:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111301632 00000100:00100000:1.0:1789048450.527963:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111301632 00000100:00100000:1.0:1789048450.527989:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789048450.527995:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111301632:12345-0@lo:400: 00000100:00100000:1.0:1789048450.528026:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111301632:12345-0@lo:400: Request processed in 30us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048450.528031:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789048450.528048:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111301248 00000100:00100000:1.0:1789048450.528052:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111301248 00000100:00100000:1.0:1789048450.528073:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111300992 00000100:00100000:1.0:1789048450.528076:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111300992 00000100:00100000:1.0:1789048450.528087:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789048450.528093:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111301248:12345-0@lo:400: 00000100:00100000:1.0:1789048450.528124:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111301248:12345-0@lo:400: Request processed in 31us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048450.528138:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789048450.528150:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789048450.528156:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111300992:12345-0@lo:400: 00000100:00100000:1.0:1789048450.528183:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111300992:12345-0@lo:400: Request processed in 27us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048450.528187:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1789048450.528222:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789048450.528226:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789048450.528228:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789048450.528252:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111300992:0@lo:400: 00010000:00080000:1.0:1789048450.528265:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c03e54e00 x1875953111301504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048450.528274:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111301504:0@lo:400: 00010000:00080000:1.0:1789048450.528284:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c2b613b80 x1875953111300864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048450.528292:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111300864:0@lo:400: 00010000:00080000:1.0:1789048450.528301:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c03e55f80 x1875953111301376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048450.528309:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111301376:0@lo:400: 00000100:00100000:1.0:1789048450.528367:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111301248:0@lo:400: 00010000:00080000:1.0:1789048450.528377:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d82300 x1875953111301120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048450.528386:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111301120:0@lo:400: 00010000:00080000:1.0:1789048450.528407:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c03e55880 x1875953111301632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048450.528414:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1789048450.528424:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111301632:0@lo:400: 00000100:00100000:0.0:1789048450.528770:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111300736 00000100:00100000:0.0:1789048450.528775:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111300736 00000100:00100000:0.0:1789048450.528814:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789048450.528830:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:3620:x1875953111300736:12345-0@lo:400: 00000100:00100000:0.0:1789048450.528872:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:3620:x1875953111300736:12345-0@lo:400: Request processed in 44us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048450.528878:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789048450.529823:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111301760:0@lo:13: 00000100:00100000:0.0:1789048450.529870:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048450.529917:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111301760 00000100:00100000:3.0:1789048450.529923:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111301760 00000100:00100000:3.0:1789048450.529962:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789048450.529970:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d311f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111301760:12345-0@lo:13: 00002000:00000024:3.0:1789048450.529987:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048450.530027:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d311f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111301760:12345-0@lo:13: Request processed in 58us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048450.530032:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789048450.530215:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111300736:0@lo:400: 00010000:00080000:3.0:1789048450.530313:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d8bb80 x1875953111301760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048450.530328:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111301760:0@lo:13: 00010000:00010000:3.0:1789048451.037581:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048451.550796:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111301888:0@lo:41: 00000100:00100000:0.0:1789048451.550865:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048451.551391:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111301888 00000100:00100000:1.0:1789048451.551399:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111301888 00000100:00100000:1.0:1789048451.551442:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789048451.551451:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111301888:12345-0@lo:41: 00000004:00000024:1.0:1789048451.551485:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789048451.551533:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111301888:12345-0@lo:41: Request processed in 83us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048451.551540:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789048451.553954:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111301888:0@lo:41: 00010000:00010000:1.0:1789048452.067791:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048453.088176:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048454.111475:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048455.135116:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789048455.135141:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111302016:0@lo:41: 00000100:00100000:1.0:1789048455.135207:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048455.135271:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111302016 00000100:00100000:1.0:1789048455.135279:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111302016 00000100:00100000:1.0:1789048455.135321:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789048455.135329:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111302016:12345-0@lo:41: 00000004:00000024:1.0:1789048455.135380:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789048455.135425:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111302016:12345-0@lo:41: Request processed in 95us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048455.135431:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789048455.135487:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111302016:0@lo:41: 00010000:00010000:3.0:1789048455.135634:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048455.645499:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111302144:0@lo:13: 00000100:00100000:3.0:1789048455.645592:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048455.645655:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789048455.645662:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111302272:0@lo:13: 00000100:00100000:3.0:1789048455.645684:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048455.645904:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111302144 00000100:00100000:3.0:1789048455.645922:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111302144 00000100:00100000:3.0:1789048455.645975:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111302272 00000100:00100000:3.0:1789048455.645979:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111302272 00000100:00100000:3.0:1789048455.646002:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789048455.646011:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111302144:12345-0@lo:13: 00002000:00000024:3.0:1789048455.646045:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048455.646091:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111302144:12345-0@lo:13: Request processed in 81us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048455.646098:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789048455.646115:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789048455.646121:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111302272:12345-0@lo:13: 00002000:00000024:3.0:1789048455.646131:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048455.646155:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111302272:12345-0@lo:13: Request processed in 35us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048455.646161:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789048455.646179:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789048455.646207:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c03e55880 x1875953111302272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048455.646226:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111302272:0@lo:13: 00010000:00080000:3.0:1789048455.646243:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d8bb80 x1875953111302144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048455.646264:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111302144:0@lo:13: 00000100:00100000:3.0:1789048455.648314:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111302528:0@lo:400: 00000100:00100000:0.0:1789048455.648373:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111302784:0@lo:400: 00000100:00100000:3.0:1789048455.648396:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048455.648432:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048455.648440:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875953111303040:0@lo:400: 00000100:00100000:0.0:1789048455.648466:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789048455.648474:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111302656:0@lo:400: 00000100:00100000:3.0:1789048455.648486:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048455.648510:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048455.648512:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789048455.648521:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111302400:0@lo:400: 00000100:00100000:0.0:1789048455.648537:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111303168:0@lo:400: 00000100:00100000:3.0:1789048455.648563:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048455.648888:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048455.648927:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111302528 00000100:00100000:0.0:1789048455.648934:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111302528 00000100:00100000:0.0:1789048455.648965:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111302784 00000100:00100000:0.0:1789048455.648967:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111302784 00000100:00100000:0.0:1789048455.648976:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111303040 00000100:00100000:0.0:1789048455.648978:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111303040 00000100:00100000:0.0:1789048455.648997:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111303168 00000100:00100000:0.0:1789048455.648999:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111303168 00000100:00100000:0.0:1789048455.649012:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789048455.649020:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111302528:12345-0@lo:400: 00000100:00100000:3.0:1789048455.649071:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111302912:0@lo:400: 00000100:00100000:1.0:1789048455.649208:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789048455.649216:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111302784:12345-0@lo:400: 00000100:00100000:0.0:1789048455.653501:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111302528:12345-0@lo:400: Request processed in 4467us (5092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048455.653526:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789048455.653576:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789048455.653590:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875953111303040:12345-0@lo:400: 00000100:00100000:0.0:1789048455.653659:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875953111303040:12345-0@lo:400: Request processed in 75us (5174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048455.653665:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789048455.653676:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789048455.653682:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111303168:12345-0@lo:400: 00000100:00100000:0.0:1789048455.653719:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111303168:12345-0@lo:400: Request processed in 38us (4832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048455.653724:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789048455.653750:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111302656 00000100:00100000:0.0:1789048455.653758:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111302656 00000100:00100000:0.0:1789048455.654458:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789048455.654468:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111302656:12345-0@lo:400: 00000100:00100000:0.0:1789048455.654527:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111302656:12345-0@lo:400: Request processed in 62us (6018us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048455.654533:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789048455.654565:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111302400 00000100:00100000:0.0:1789048455.654569:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111302400 00000100:00100000:0.0:1789048455.654594:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789048455.654599:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:3623:x1875953111302400:12345-0@lo:400: 00000100:00100000:0.0:1789048455.654630:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:3623:x1875953111302400:12345-0@lo:400: Request processed in 30us (6077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048455.654636:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1789048455.654664:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789048455.654673:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789048455.654704:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111302656:0@lo:400: 00010000:00080000:0.0:1789048455.654718:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c20221f80 x1875953111303168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048455.654729:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111303168:0@lo:400: 00000100:00100000:3.0:1789048455.655178:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789048455.655222:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c20221880 x1875953111303040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048455.655232:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875953111303040:0@lo:400: 00010000:00080000:3.0:1789048455.655245:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3d311180 x1875953111302528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048455.655253:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111302528:0@lo:400: 00000100:00100000:3.0:1789048455.655271:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111302400:0@lo:400: 00000100:00100000:1.0:1789048455.655362:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111302912 00000100:00100000:1.0:1789048455.655368:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111302912 00000100:00100000:1.0:1789048455.655395:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789048455.655402:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111302912:12345-0@lo:400: 00000100:00100000:1.0:1789048455.655443:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111302912:12345-0@lo:400: Request processed in 42us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048455.655449:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789048455.655475:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111302912:0@lo:400: 00000100:00100000:1.0:1789048455.656990:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111302784:12345-0@lo:400: Request processed in 7766us (8550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048455.657002:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1789048455.657283:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3d312d80 x1875953111302784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048455.657297:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111302784:0@lo:400: 00010000:00010000:3.0:1789048456.159103:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048456.678428:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111303296:0@lo:41: 00000100:00100000:1.0:1789048456.678501:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048456.679371:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111303296 00000100:00100000:3.0:1789048456.679382:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111303296 00000100:00100000:3.0:1789048456.679438:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789048456.679448:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111303296:12345-0@lo:41: 00000004:00000024:3.0:1789048456.679483:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789048456.679577:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111303296:12345-0@lo:41: Request processed in 130us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048456.679584:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789048456.683803:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111303296:0@lo:41: 00010000:00010000:3.0:1789048457.181404:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048458.209460:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048459.248717:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048460.255873:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048460.256755:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789048460.256779:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111303424:0@lo:41: 00000100:00100000:3.0:1789048460.256856:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048460.256945:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111303424 00000100:00100000:0.0:1789048460.256954:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111303424 00000100:00100000:0.0:1789048460.257006:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789048460.257015:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111303424:12345-0@lo:41: 00000004:00000024:0.0:1789048460.257050:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789048460.257098:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111303424:12345-0@lo:41: Request processed in 84us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048460.257105:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789048460.257146:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111303424:0@lo:41: 00000100:00100000:3.0:1789048460.767448:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789048460.767485:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111303552:0@lo:13: 00000100:00100000:3.0:1789048460.767583:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048460.767654:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111303552 00000100:00100000:3.0:1789048460.767661:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111303552 00000100:00100000:3.0:1789048460.767708:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789048460.767719:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111303552:12345-0@lo:13: 00002000:00000024:3.0:1789048460.767747:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048460.767791:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111303552:12345-0@lo:13: Request processed in 75us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048460.767798:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789048460.767832:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b05d8b480 x1875953111303552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048460.767851:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111303552:0@lo:13: 00000100:00100000:1.0:1789048460.768652:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789048460.768666:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111303680:0@lo:13: 00000100:00100000:1.0:1789048460.768703:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048460.769720:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111303680 00000100:00100000:3.0:1789048460.769728:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111303680 00000100:00100000:3.0:1789048460.769773:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789048460.769783:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111303680:12345-0@lo:13: 00002000:00000024:3.0:1789048460.769802:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048460.769863:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111303680:12345-0@lo:13: Request processed in 81us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048460.769870:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789048460.770198:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c03e54a80 x1875953111303680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048460.770216:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111303680:0@lo:13: 00000100:00080000:1.0:1789048460.770386:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789048460.772946:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111304192:0@lo:400: 00000100:00100000:3.0:1789048460.773020:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048460.773062:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789048460.773068:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111303808:0@lo:400: 00000100:00100000:3.0:1789048460.774262:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048460.774303:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111304320:0@lo:400: 00000100:00100000:3.0:1789048460.774352:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048460.774381:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111304192 00000100:00100000:3.0:1789048460.774387:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111304192 00000100:00100000:3.0:1789048460.774433:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789048460.774441:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111304192:12345-0@lo:400: 00000100:00100000:1.0:1789048460.775153:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111303808 00000100:00100000:1.0:1789048460.775159:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111303808 00000100:00100000:1.0:1789048460.775193:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789048460.775200:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:3620:x1875953111303808:12345-0@lo:400: 00000100:00100000:1.0:1789048460.775249:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:3620:x1875953111303808:12345-0@lo:400: Request processed in 50us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048460.775256:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789048460.775356:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111304320 00000100:00100000:0.0:1789048460.775360:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111304320 00000100:00100000:0.0:1789048460.775403:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789048460.775410:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111304320:12345-0@lo:400: 00000100:00100000:0.0:1789048460.775446:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111304320:12345-0@lo:400: Request processed in 37us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048460.775451:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789048460.775673:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111304192:12345-0@lo:400: Request processed in 1232us (2652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048460.775680:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789048460.775705:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111304064:0@lo:400: 00000100:00100000:3.0:1789048460.775735:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048460.775771:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789048460.775779:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111303936:0@lo:400: 00000100:00100000:3.0:1789048460.775799:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048460.775816:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111304448:0@lo:400: 00000100:00100000:3.0:1789048460.775853:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048460.775878:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111304064 00000100:00100000:3.0:1789048460.775882:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111304064 00000100:00100000:3.0:1789048460.775902:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111303936 00000100:00100000:3.0:1789048460.775911:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111303936 00000100:00100000:3.0:1789048460.775927:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111304448 00000100:00100000:3.0:1789048460.775929:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111304448 00000100:00100000:3.0:1789048460.775944:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789048460.775950:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111304064:12345-0@lo:400: 00000100:00100000:3.0:1789048460.775984:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111304064:12345-0@lo:400: Request processed in 34us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048460.775990:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789048460.776002:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789048460.776007:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111303936:12345-0@lo:400: 00000100:00100000:3.0:1789048460.776032:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111303936:12345-0@lo:400: Request processed in 25us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048460.776037:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789048460.776048:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789048460.776054:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111304448:12345-0@lo:400: 00000100:00080000:1.0:1789048460.776185:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789048460.776189:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048460.777730:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111304448:12345-0@lo:400: Request processed in 1671us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048460.777743:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1789048460.777797:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b0747df80 x1875953111303936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048460.777812:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111303936:0@lo:400: 00010000:00080000:3.0:1789048460.777822:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b0747fb80 x1875953111304448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048460.777830:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111304448:0@lo:400: 00010000:00080000:3.0:1789048460.777839:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b0747ce00 x1875953111304064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048460.777859:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111304064:0@lo:400: 00000100:00100000:3.0:1789048460.777896:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111303808:0@lo:400: 00010000:00080000:3.0:1789048460.777908:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b0747dc00 x1875953111304320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048460.777917:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111304320:0@lo:400: 00000100:00100000:3.0:1789048460.777927:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111304192:0@lo:400: 00000020:01000004:1.0:1789048460.827251:0:9491:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789048460.827255:0:9491:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789048460.827256:0:9491:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789048460.830797:0:9491:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff959b06952000 00000020:01000004:1.0:1789048460.830825:0:9491:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789048460.830840:0:9491:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789048460.830855:0:9491:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff959c202299c0) 00000020:00000080:1.0:1789048460.830876:0:9491:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789048460.890182:0:9491:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789048460.890241:0:9491:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1789048460.911835:0:9491:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789048460.912043:0:9491:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789048460.912057:0:9491:0:(osd_handler.c:8921:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789048460.912068:0:9491:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x133f221c08775c80 00000020:01000004:3.0:1789048460.912075:0:9491:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789048460.912097:0:9491:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789048460.912100:0:9491:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789048460.912106:0:9491:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789048460.912132:0:9491:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789048460.912136:0:9491:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789048460.969017:0:9491:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789048460.974422:0:9491:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.116@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1789048460.974430:0:9491:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789048460.974432:0:9491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789048460.974433:0:9491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789048460.974435:0:9491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789048460.974436:0:9491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789048460.974437:0:9491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789048460.974439:0:9491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789048460.974441:0:9491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789048460.974442:0:9491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789048460.974443:0:9491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789048460.974444:0:9491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789048460.974448:0:9491:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1789048460.974450:0:9491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789048460.974452:0:9491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789048460.974453:0:9491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789048460.974454:0:9491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789048460.974460:0:9491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789048460.974461:0:9491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789048460.974462:0:9491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789048460.974463:0:9491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789048460.974464:0:9491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789048460.974466:0:9491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789048460.974466:0:9491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789048460.974515:0:9491:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789048460.974535:0:9491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111304576:0@lo:253: 00000100:00100000:1.0:1789048460.974626:0:9491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048460.974671:0:9491:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2ae25cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048460.977056:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111304576 00000100:00100000:0.0:1789048460.977071:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111304576 00000100:00100000:0.0:1789048460.977135:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789048460.977146:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:9491:x1875953111304576:12345-0@lo:253: 20000000:01000000:0.0:1789048460.977197:0:6492:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789048460.977201:0:6492:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789048460.977205:0:6492:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789048460.977208:0:6492:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789048460.977551:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789048460.977689:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1789048460.977701:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789048460.977713:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1789048460.977716:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789048460.977723:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1789048460.977731:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1789048460.977792:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1789048460.977802:0:6492:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.116@tcp 20000000:01000000:0.0:1789048460.977803:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:0.0:1789048460.977811:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1789048460.977814:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789048460.977824:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1789048460.977827:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:0.0:1789048460.977988:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1789048460.977996:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789048460.978005:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1789048460.978014:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1789048460.978061:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1789048460.978073:0:6492:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.116@tcp 20000000:01000000:0.0:1789048460.978074:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:0.0:1789048460.978087:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1789048460.978101:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789048460.978116:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1789048460.978122:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:0.0:1789048460.978131:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1789048460.978134:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789048460.978142:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1789048460.978150:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1789048460.978772:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1789048460.978787:0:6492:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.116@tcp 20000000:01000000:1.0:1789048460.978789:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:1.0:1789048460.978802:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1789048460.978807:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789048460.978821:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1789048460.978826:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:1.0:1789048460.978838:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1789048460.978844:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789048460.978872:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1789048460.978888:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1789048460.979096:0:6492:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789048460.979100:0:6492:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789048460.979104:0:6492:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789048460.979151:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789048460.979154:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789048460.980791:0:9497:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1789048460.980843:0:9497:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1789048460.980856:0:9497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789048460.981189:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789048460.981212:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1789048460.981228:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1789048460.981237:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789048460.981239:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789048460.984282:0:9498:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1789048460.984363:0:9498:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1789048460.984386:0:9498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1789048460.984598:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1789048460.984624:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1789048460.984652:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1789048460.984664:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789048460.984667:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789048460.987675:0:9499:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1789048460.987720:0:9499:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1789048460.987737:0:9499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1789048460.988060:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1789048460.988084:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1789048460.988099:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1789048460.988108:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789048460.988111:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789048460.989636:0:9500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1789048460.989810:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1789048460.989847:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1789048460.989868:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1789048460.989879:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789048460.989881:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789048460.990840:0:9501:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1789048460.990875:0:9501:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1789048460.990890:0:9501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1789048460.991108:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1789048460.991127:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1789048460.991142:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:1.0:1789048460.991156:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789048460.991179:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff959c013d7800/0x133f221c08775c87 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048460.991196:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c013d6800/0x133f221c08775b7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775b76 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048460.991204:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c013d6600/0x133f221c08775ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775ba0 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048460.991210:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c0147b200/0x133f221c08775be6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775bdf expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048460.991217:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c0147ba00/0x133f221c08775c02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775bfb expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048460.991224:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c02837c00/0x133f221c08775c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775c25 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048460.991238:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c013d7a00/0x133f221c08775c48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775c41 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048460.991244:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c00030a00/0x133f221c08775c6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775c64 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048460.991250:0:6492:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959c013d7800/0x133f221c08775c87 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048460.991285:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c00030a00/0x133f221c08775c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775c64 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048460.991300:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c00030a00/0x133f221c08775c6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775c64 expref: 21 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048460.991315:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1875953111304704:0@lo:104: 00000100:00100000:1.0:1789048460.991419:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789048460.991468:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c013d7a00/0x133f221c08775c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775c41 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048460.991477:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c013d7a00/0x133f221c08775c48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775c41 expref: 21 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048460.991485:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1875953111304832:0@lo:104: 00000100:00100000:1.0:1789048460.991516:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789048460.991536:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c02837c00/0x133f221c08775c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775c25 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048460.991543:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c02837c00/0x133f221c08775c2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775c25 expref: 21 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048460.991558:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e55180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1875953111304960:0@lo:104: 00000100:00100000:1.0:1789048460.991592:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789048460.991625:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c0147ba00/0x133f221c08775c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775bfb expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048460.991643:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c0147ba00/0x133f221c08775c02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775bfb expref: 21 pid: 6491 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048460.991651:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e55880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1875953111305088:0@lo:104: 00000100:00100000:1.0:1789048460.991672:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048460.991687:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111304704 00010000:00010000:1.0:1789048460.991687:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c0147b200/0x133f221c08775be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775bdf expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048460.991692:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111304704 00010000:00010000:1.0:1789048460.991694:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c0147b200/0x133f221c08775be6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775bdf expref: 21 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048460.991701:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d82680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1875953111305216:0@lo:104: 00000100:00100000:1.0:1789048460.991718:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048460.991724:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111304832 00000100:00100000:2.0:1789048460.991727:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111304832 00000100:00100000:2.0:1789048460.991736:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111304960 00000100:00100000:2.0:1789048460.991738:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111304960 00000100:00100000:2.0:1789048460.991746:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111305088 00010000:00010000:1.0:1789048460.991746:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c013d6600/0x133f221c08775ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775ba0 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048460.991748:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111305088 00010000:00010000:1.0:1789048460.991754:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c013d6600/0x133f221c08775ba7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775ba0 expref: 21 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048460.991755:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111305216 00000100:00100000:2.0:1789048460.991758:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111305216 00000100:00100000:1.0:1789048460.991762:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b611880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1875953111305344:0@lo:104: 00000100:00100000:2.0:1789048460.991769:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789048460.991777:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+7:6492:x1875953111304704:12345-0@lo:104: 00000100:00100000:1.0:1789048460.991782:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789048460.991789:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775c6b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048460.991795:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c013d6800/0x133f221c08775b7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775b76 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048460.991809:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c013d6800/0x133f221c08775b7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775b76 expref: 21 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048460.991816:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1875953111305472:0@lo:104: 00010000:00010000:2.0:1789048460.991848:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789048460.991853:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+7:6492:x1875953111304704:12345-0@lo:104: Request processed in 78us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048460.991860:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789048460.991882:0:6479:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789048460.991896:0:6479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048460.991917:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111305344 00000100:00100000:2.0:1789048460.991922:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111305344 00000100:00100000:2.0:1789048460.991935:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111305472 00000100:00100000:2.0:1789048460.991937:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111305472 00000100:00100000:2.0:1789048460.991947:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789048460.991951:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+8:6492:x1875953111304832:12345-0@lo:104: 00010000:00010000:2.0:1789048460.991958:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775c48 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.991991:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789048460.991995:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+8:6492:x1875953111304832:12345-0@lo:104: Request processed in 45us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048460.992000:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789048460.992011:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789048460.992016:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+7:6492:x1875953111304960:12345-0@lo:104: 00010000:00010000:2.0:1789048460.992022:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c00031a00/0x133f221c08775c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775c2c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992050:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789048460.992065:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+7:6492:x1875953111304960:12345-0@lo:104: Request processed in 49us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048460.992079:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789048460.992091:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789048460.992097:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+6:6492:x1875953111305088:12345-0@lo:104: 00010000:00010000:2.0:1789048460.992104:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775c02 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992128:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789048460.992132:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+6:6492:x1875953111305088:12345-0@lo:104: Request processed in 37us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048460.992137:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789048460.992147:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789048460.992152:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+5:6492:x1875953111305216:12345-0@lo:104: 00010000:00010000:2.0:1789048460.992159:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c0147a400/0x133f221c08775bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775be6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992182:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789048460.992187:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+5:6492:x1875953111305216:12345-0@lo:104: Request processed in 36us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048460.992192:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789048460.992202:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789048460.992208:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3eb64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:6492:x1875953111305344:12345-0@lo:104: 00010000:00010000:2.0:1789048460.992214:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c013d7400/0x133f221c08775ba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775ba7 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992235:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789048460.992239:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3eb64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:6492:x1875953111305344:12345-0@lo:104: Request processed in 33us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048460.992240:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c03785180 going to sleep for 11 seconds 00000100:00100000:2.0:1789048460.992249:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789048460.992260:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1875953111304704:0@lo:104: 00000100:00100000:1.0:1789048460.992267:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1875953111304832:0@lo:104: 00000100:00100000:2.0:1789048460.992272:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789048460.992273:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e55180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1875953111304960:0@lo:104: 00000100:00100000:2.0:1789048460.992278:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:6492:x1875953111305472:12345-0@lo:104: 00000100:00100000:1.0:1789048460.992279:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e55880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1875953111305088:0@lo:104: 00010000:00010000:2.0:1789048460.992285:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775b76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775b7d expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048460.992285:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d82680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1875953111305216:0@lo:104: 00000100:00100000:1.0:1789048460.992291:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b611880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1875953111305344:0@lo:104: 00010000:00010000:2.0:1789048460.992317:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789048460.992322:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:6492:x1875953111305472:12345-0@lo:104: Request processed in 44us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048460.992325:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1875953111305472:0@lo:104: 00000100:00100000:2.0:1789048460.992327:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789048460.992359:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789048460.992365:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775c6b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048460.992367:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff959c013d7800/0x133f221c08775c87 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992372:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836c00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048460.992376:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775c6b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992384:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775c6b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048460.992392:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775c6b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048460.992397:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789048460.992427:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775c64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775c6b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992433:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048460.992458:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775c64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775c6b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992465:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775c64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775c6b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992478:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789048460.992482:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775c48 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992488:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c00031800 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048460.992491:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775c48 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992514:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775c48 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048460.992520:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775c48 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048460.992525:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789048460.992559:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775c41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775c48 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992564:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048460.992587:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775c41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775c48 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992594:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775c41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775c48 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992604:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789048460.992613:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c00031a00/0x133f221c08775c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775c2c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992618:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c00031a00 already unused, calling callback (ffffffffc1289c20) 00000100:00100000:0.0:1789048460.992620:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111305728:0@lo:103: 10000000:00010000:2.0:1789048460.992621:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c00031a00/0x133f221c08775c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775c2c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992628:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c00031a00/0x133f221c08775c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775c2c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048460.992634:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c00031a00/0x133f221c08775c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775c2c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048460.992639:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789048460.992651:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c00031a00/0x133f221c08775c25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775c2c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992657:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789048460.992661:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789048460.992662:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c00031a00/0x133f221c08775c25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775c2c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992668:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c00031a00/0x133f221c08775c25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775c2c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992678:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789048460.992682:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775c02 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992687:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837200 already unused, calling callback (ffffffffc1289c20) 00000100:00100000:0.0:1789048460.992688:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 10000000:00010000:2.0:1789048460.992690:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775c02 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048460.992693:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111305856:0@lo:103: 00010000:00010000:2.0:1789048460.992706:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775bfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775c02 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048460.992710:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1789048460.992713:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775bfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775c02 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048460.992718:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789048460.992730:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775bfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775c02 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992736:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048460.992741:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775bfb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775c02 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992748:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775bfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775c02 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992758:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789048460.992762:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c0147a400/0x133f221c08775bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775be6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992767:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c0147a400 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048460.992770:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c0147a400/0x133f221c08775bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775be6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992777:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c0147a400/0x133f221c08775bdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775be6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048460.992783:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c0147a400/0x133f221c08775bdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775be6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048460.992794:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789048460.992807:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c0147a400/0x133f221c08775bdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775be6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992813:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048460.992817:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c0147a400/0x133f221c08775bdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775be6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048460.992823:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111305728 00010000:00010000:2.0:1789048460.992823:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c0147a400/0x133f221c08775bdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775be6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048460.992828:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111305728 00010000:00010000:2.0:1789048460.992832:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789048460.992835:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c013d7400/0x133f221c08775ba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775ba7 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992841:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c013d7400 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048460.992844:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c013d7400/0x133f221c08775ba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775ba7 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992850:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c013d7400/0x133f221c08775ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775ba7 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048460.992856:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c013d7400/0x133f221c08775ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775ba7 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.992857:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c013d7a00/0x133f221c08775c48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775c41 expref: 22 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048460.992862:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789048460.992872:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c013d7400/0x133f221c08775ba0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775ba7 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992877:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789048460.992883:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111305856 00000100:00100000:3.0:1789048460.992886:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111305856 00010000:00010000:2.0:1789048460.992892:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c013d7400/0x133f221c08775ba0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775ba7 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.992896:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c02837c00/0x133f221c08775c2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775c25 expref: 23 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992900:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c013d7400/0x133f221c08775ba0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775ba7 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048460.992908:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1789048460.992909:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048460.992912:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775b76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775b7d expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048460.992913:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06973800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:3620:x1875953111305728:12345-0@lo:103: 00010000:00010000:2.0:1789048460.992918:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836e00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048460.992920:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775b76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775b7d expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.992923:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048460.992928:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c013d7a00/0x133f221c08775c48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775c41 expref: 23 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992928:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775b7d expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048460.992935:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775b7d expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.992937:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c013d7a00/0x133f221c08775c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775c41 expref: 23 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048460.992940:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789048460.992950:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c013d7a00/0x133f221c08775c48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775c41 expref: 23 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992959:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775b76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775b7d expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.992960:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789048460.992964:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048460.992969:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775b76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775b7d expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048460.992975:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775b76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775b7d expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048460.992983:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06973800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:3620:x1875953111305728:12345-0@lo:103: Request processed in 70us (322us total) trans 0 rc 0/0 00010000:00010000:2.0:1789048460.992987:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048460.992989:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1789048460.992992:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048460.992994:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048460.993001:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048460.993002:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789048460.993007:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06971f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:3620:x1875953111305856:12345-0@lo:103: 00010000:00010000:2.0:1789048460.993007:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048460.993014:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789048460.993016:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111305600:0@lo:103: 00010000:00010000:3.0:1789048460.993018:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c02837c00/0x133f221c08775c2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775c25 expref: 21 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.993032:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c02837c00/0x133f221c08775c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775c25 expref: 21 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048460.993038:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789048460.993042:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c02837c00/0x133f221c08775c2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775c25 expref: 21 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048460.993048:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111306112:0@lo:103: 00010000:00010000:3.0:1789048460.993050:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048460.993066:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048460.993070:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06971f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:3620:x1875953111305856:12345-0@lo:103: Request processed in 63us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048460.993075:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789048460.993075:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789048460.993079:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111305984:0@lo:103: 00000100:00100000:3.0:1789048460.993085:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111305600 00000100:00100000:3.0:1789048460.993087:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111305600 00000100:00100000:2.0:1789048460.993096:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789048460.993097:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c00030a00/0x133f221c08775c6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775c64 expref: 20 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048460.993107:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111306112 00000100:00100000:3.0:1789048460.993110:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111306112 00000100:00100000:2.0:1789048460.993115:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111306368:0@lo:103: 00010000:00010000:3.0:1789048460.993118:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c0147b200/0x133f221c08775be6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775bdf expref: 21 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048460.993128:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111305984 00000100:00100000:3.0:1789048460.993131:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111305984 00000100:00100000:2.0:1789048460.993134:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789048460.993139:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c0147ba00/0x133f221c08775c02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775bfb expref: 22 pid: 6491 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048460.993143:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789048460.993148:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111306240:0@lo:103: 00000100:00100000:3.0:1789048460.993149:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111306368 00000100:00100000:3.0:1789048460.993151:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111306368 00010000:00010000:3.0:1789048460.993159:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c013d6800/0x133f221c08775b7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775b76 expref: 23 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048460.993163:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048460.993169:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111306240 00000100:00100000:3.0:1789048460.993176:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111306240 00000100:00100000:2.0:1789048460.993186:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111305856:0@lo:103: 00010000:00010000:3.0:1789048460.993188:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c013d6600/0x133f221c08775ba7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775ba0 expref: 24 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048460.993193:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111305728:0@lo:103: 00000100:00100000:3.0:1789048460.993200:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789048460.993205:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3623:x1875953111305600:12345-0@lo:103: 00010000:00010000:3.0:1789048460.993212:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048460.993216:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c00030a00/0x133f221c08775c6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775c64 expref: 24 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.993224:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c00030a00/0x133f221c08775c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775c64 expref: 24 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.993233:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c00030a00/0x133f221c08775c6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775c64 expref: 24 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.993244:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048460.993275:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:3623:x1875953111305600:12345-0@lo:103: Request processed in 70us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048460.993280:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789048460.993292:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789048460.993297:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2aecf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:3623:x1875953111306112:12345-0@lo:103: 00010000:00010000:3.0:1789048460.993305:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048460.993308:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c0147b200/0x133f221c08775be6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775bdf expref: 22 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.993315:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c0147b200/0x133f221c08775be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775bdf expref: 22 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.993323:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c0147b200/0x133f221c08775be6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775bdf expref: 22 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.993370:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048460.993393:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2aecf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:3623:x1875953111306112:12345-0@lo:103: Request processed in 96us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048460.993398:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789048460.993430:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789048460.993436:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:3623:x1875953111305984:12345-0@lo:103: 00010000:00010000:3.0:1789048460.993442:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048460.993447:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c0147ba00/0x133f221c08775c02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775bfb expref: 20 pid: 6491 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.993455:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c0147ba00/0x133f221c08775c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775bfb expref: 20 pid: 6491 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.993463:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c0147ba00/0x133f221c08775c02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775bfb expref: 20 pid: 6491 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.993471:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048460.993489:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:3623:x1875953111305984:12345-0@lo:103: Request processed in 54us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048460.993495:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789048460.993516:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789048460.993522:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:3621:x1875953111306368:12345-0@lo:103: 00010000:00010000:3.0:1789048460.993529:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048460.993532:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c013d6800/0x133f221c08775b7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775b76 expref: 18 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.993540:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c013d6800/0x133f221c08775b7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775b76 expref: 18 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.993555:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c013d6800/0x133f221c08775b7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775b76 expref: 18 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.993565:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048460.993591:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:3621:x1875953111306368:12345-0@lo:103: Request processed in 70us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048460.993597:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789048460.993609:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789048460.993614:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:3621:x1875953111306240:12345-0@lo:103: 00010000:00010000:3.0:1789048460.993621:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048460.993625:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c013d6600/0x133f221c08775ba7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775ba0 expref: 16 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048460.995296:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111305984:0@lo:103: 00000100:00100000:2.0:1789048460.995310:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111305600:0@lo:103: 00000100:00100000:2.0:1789048460.995318:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111306112:0@lo:103: 00010000:00010000:3.0:1789048460.995392:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c013d6600/0x133f221c08775ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775ba0 expref: 16 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.995409:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c013d6600/0x133f221c08775ba7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775ba0 expref: 16 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.995425:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959c013d7800/0x133f221c08775c87 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.995434:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c013d7800/0x133f221c08775c87 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.995453:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c013d7800/0x133f221c08775c87 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.995461:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c013d7800/0x133f221c08775c87 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.995478:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff959c013d7800/0x133f221c08775c87 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.995485:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff959c013d7800/0x133f221c08775c87 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.995491:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c013d7800 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048460.995495:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff959c013d7800/0x133f221c08775c87 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.995511:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff959c013d7800/0x133f221c08775c87 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.995534:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff959c013d7800/0x133f221c08775c87 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048460.995546:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048460.995596:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:3621:x1875953111306240:12345-0@lo:103: Request processed in 1981us (2430us total) trans 0 rc 0/0 00010000:00010000:1.0:1789048460.995597:0:6492:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff959c013d7800/0x133f221c08775c87 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048460.995604:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1789048460.995606:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff959c013d7800/0x133f221c08775c87 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048460.995611:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c013d7800/0x133f221c08775c87 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789048460.995626:0:6492:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789048460.995639:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111306240:0@lo:103: 00000100:00100000:3.0:1789048460.995647:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111306368:0@lo:103: 00000100:00100000:1.0:1789048461.007288:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:9491:x1875953111304576:12345-0@lo:253: Request processed in 30133us (32651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048461.007314:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789048461.007403:0:9491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111304576:0@lo:253: 10000000:01000000:3.0:1789048461.007419:0:9491:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789048461.007422:0:9491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789048461.007424:0:9491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789048461.007425:0:9491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789048461.007426:0:9491:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789048461.007433:0:9491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789048461.007435:0:9491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789048461.007436:0:9491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789048461.007438:0:9491:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789048461.007440:0:9491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789048461.007441:0:9491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789048461.007463:0:9491:0:(tgt_mount.c:101:server_register_mount()) register mount ffff959b06952000 from lustre-OST0001 10000000:01000000:3.0:1789048461.007493:0:9491:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789048461.007496:0:9491:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789048461.007514:0:9491:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff959c394bb380 local copy 10000000:01000000:3.0:1789048461.007518:0:9491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789048461.007555:0:9491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08775c8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.007566:0:9491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08775c8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.007574:0:9491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08775c8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048461.007593:0:9491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111306496:0@lo:101: 00000100:00100000:3.0:1789048461.007628:0:9491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048461.007656:0:9491:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06980240 going to sleep for 11 seconds 00000100:00100000:0.0:1789048461.008051:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111306496 00000100:00100000:0.0:1789048461.008069:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111306496 00000100:00100000:0.0:1789048461.008115:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789048461.008126:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+14:9491:x1875953111306496:12345-0@lo:101: 00010000:00010000:0.0:1789048461.008139:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048461.008152:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c00031000/0x133f221c08775c95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775c8e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048461.008179:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c00031000/0x133f221c08775c95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775c8e expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048461.008188:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c00031000/0x133f221c08775c95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775c8e expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048461.008196:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c00031000, rc 0) 00000100:00100000:0.0:1789048461.008241:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:9491:x1875953111306496:12345-0@lo:101: Request processed in 117us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048461.008258:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789048461.008771:0:9491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111306496:0@lo:101: 00010000:00010000:2.0:1789048461.008788:0:9491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08775c8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x133f221c08775c95 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048461.008811:0:9491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08775c8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x133f221c08775c95 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048461.008915:0:9491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111306624:0@lo:501: 00000100:00100000:2.0:1789048461.008945:0:9491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048461.008977:0:9491:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0745f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789048461.009012:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111306624 00000100:00100000:0.0:1789048461.009017:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111306624 00000100:00100000:0.0:1789048461.009053:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789048461.009061:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:9491:x1875953111306624:12345-0@lo:501: 00000100:00100000:0.0:1789048461.009121:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:9491:x1875953111306624:12345-0@lo:501: Request processed in 60us (175us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789048461.009127:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789048461.009778:0:9491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111306624:0@lo:501: 10000000:01000000:2.0:1789048461.009792:0:9491:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789048461.009814:0:9491:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789048461.009820:0:9491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08775c8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x133f221c08775c95 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048461.009828:0:9491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08775c8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x133f221c08775c95 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048461.009835:0:9491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08775c8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x133f221c08775c95 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048461.009859:0:9491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789048461.009883:0:9491:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff959b06952000 10000000:01000000:2.0:1789048461.009888:0:9491:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789048461.009893:0:9491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789048461.009904:0:9491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789048461.009909:0:9491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789048461.009912:0:9491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789048461.009931:0:9491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775c9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048461.009952:0:9491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775c9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048461.009961:0:9491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775c9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048461.009974:0:9491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111306752:0@lo:101: 00000100:00100000:2.0:1789048461.010004:0:9491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048461.010035:0:9491:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0745f000 going to sleep for 11 seconds 00000100:00100000:0.0:1789048461.010139:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111306752 00000100:00100000:0.0:1789048461.010145:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111306752 00000100:00100000:0.0:1789048461.010187:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789048461.010194:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:9491:x1875953111306752:12345-0@lo:101: 00010000:00010000:0.0:1789048461.010202:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048461.010213:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c00030000/0x133f221c08775ca3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775c9c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048461.010230:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c00030000/0x133f221c08775ca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775c9c expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048461.010240:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048461.010240:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c00030000/0x133f221c08775ca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775c9c expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048461.010246:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08775c8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x133f221c08775c95 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048461.010248:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c00030000, rc 0) 00010000:00010000:1.0:1789048461.010253:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d800 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048461.010257:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08775c8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x133f221c08775c95 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048461.010265:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08775c8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x133f221c08775c95 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048461.010272:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08775c8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x133f221c08775c95 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048461.010276:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:9491:x1875953111306752:12345-0@lo:101: Request processed in 83us (271us total) trans 0 rc 0/0 10000000:01000000:1.0:1789048461.010278:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789048461.010282:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00010000:1.0:1789048461.010296:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08775c8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x133f221c08775c95 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048461.010302:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048461.010320:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08775c8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x133f221c08775c95 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048461.010327:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08775c8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x133f221c08775c95 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048461.010328:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111306880:0@lo:103: 00010000:00010000:1.0:1789048461.010363:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048461.010364:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048461.010366:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048461.010386:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048461.010580:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111306880 00000100:00100000:1.0:1789048461.010598:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111306880 00000100:00100000:2.0:1789048461.010616:0:9491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111306752:0@lo:101: 00010000:00010000:2.0:1789048461.010628:0:9491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775c9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775ca3 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048461.010636:0:9491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775c9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775ca3 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048461.010637:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789048461.010643:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06970e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:3622:x1875953111306880:12345-0@lo:103: 00010000:00010000:1.0:1789048461.010652:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048461.010662:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c00031000/0x133f221c08775c95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08775c8e expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048461.010671:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048461.010691:0:9491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111307008:0@lo:501: 00000100:00100000:1.0:1789048461.010700:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06970e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:3622:x1875953111306880:12345-0@lo:103: Request processed in 57us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048461.010706:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789048461.010712:0:9491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048461.010730:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111306880:0@lo:103: 00000100:00100000:2.0:1789048461.010731:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111307008 00000100:00100000:2.0:1789048461.010734:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111307008 00000100:00100000:2.0:1789048461.010758:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789048461.010765:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:9491:x1875953111307008:12345-0@lo:501: 00000100:00100000:2.0:1789048461.010867:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:9491:x1875953111307008:12345-0@lo:501: Request processed in 102us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048461.010873:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789048461.010899:0:9491:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0745f000 going to sleep for 11 seconds 00000100:00100000:2.0:1789048461.010916:0:9491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111307008:0@lo:501: 00000100:00100000:2.0:1789048461.010938:0:9491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111307136:0@lo:503: 00000100:00100000:2.0:1789048461.010977:0:9491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048461.010999:0:9491:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0745f000 going to sleep for 11 seconds 00000100:00100000:1.0:1789048461.011219:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111307136 00000100:00100000:1.0:1789048461.011223:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111307136 00000100:00100000:1.0:1789048461.011253:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789048461.011260:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:9491:x1875953111307136:12345-0@lo:503: 00000100:00100000:1.0:1789048461.011357:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:9491:x1875953111307136:12345-0@lo:503: Request processed in 97us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048461.011364:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789048461.012279:0:9491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111307136:0@lo:503: 00000040:00080000:2.0:1789048461.012874:0:9491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789048461.013029:0:9491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111307264:0@lo:502: 00000100:00100000:2.0:1789048461.013155:0:9491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048461.013199:0:9491:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0745f000 going to sleep for 11 seconds 00000100:00100000:0.0:1789048461.013440:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111307264 00000100:00100000:0.0:1789048461.013447:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111307264 00000100:00100000:1.0:1789048461.013559:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789048461.013568:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:9491:x1875953111307264:12345-0@lo:502: 00000100:00100000:1.0:1789048461.013681:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:9491:x1875953111307264:12345-0@lo:502: Request processed in 114us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048461.013688:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789048461.013783:0:9491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111307264:0@lo:502: 00000040:00080000:0.0:1789048461.013984:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789048461.014013:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789048461.014028:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789048461.014041:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789048461.014056:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789048461.014069:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789048461.014092:0:9491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06971880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111307392:0@lo:502: 00000100:00100000:0.0:1789048461.014128:0:9491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048461.014159:0:9491:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06976d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789048461.014438:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111307392 00000100:00100000:1.0:1789048461.014443:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111307392 00000100:00100000:1.0:1789048461.014471:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789048461.014485:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:9491:x1875953111307392:12345-0@lo:502: 00000100:00100000:1.0:1789048461.014560:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:9491:x1875953111307392:12345-0@lo:502: Request processed in 76us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048461.014567:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789048461.014949:0:9491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06971880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111307392:0@lo:502: 00000040:00080000:0.0:1789048461.014995:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789048461.015005:0:9491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1789048461.015481:0:9502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789048461.015489:0:9502:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789048461.015496:0:9502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048461.015498:0:9502:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789048461.015514:0:9502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789048461.015529:0:9502:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff959c20228000) 00000020:00000080:1.0:1789048461.015551:0:9502:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789048461.015557:0:9502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789048461.015626:0:9502:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959b06952000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789048461.015634:0:9502:0:(osd_handler.c:8921:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789048461.015640:0:9502:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x133f221c08775cb1 00010000:00010000:1.0:1789048461.026225:0:9502:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1789048461.032553:0:9502:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789048461.037116:0:9502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789048461.037715:0:9502:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789048461.046982:0:9502:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1789048461.047172:0:9502:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1789048461.057280:0:9502:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1789048461.061514:0:9502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789048461.061526:0:9502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048461.061540:0:9502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048461.061543:0:9502:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789048461.061546:0:9502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048461.061622:0:9502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048461.061624:0:9502:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789048461.061629:0:9502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789048461.061631:0:9502:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789048461.061659:0:9502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048461.061662:0:9502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048461.061663:0:9502:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789048461.061666:0:9502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789048461.065175:0:9491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789048461.065225:0:9491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789048461.065317:0:9491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775c9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775ca3 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048461.065345:0:9491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775c9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775ca3 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048461.065355:0:9491:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959b06952000 from 1 10000000:01000000:2.0:1789048461.065358:0:9491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789048461.065400:0:9491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775cb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048461.065409:0:9491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775cb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048461.065420:0:9491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775cb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048461.065444:0:9491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111307520:0@lo:101: 00000100:00100000:2.0:1789048461.065541:0:9491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048461.065588:0:9491:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0745ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789048461.066485:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111307520 00000100:00100000:0.0:1789048461.066495:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111307520 00000100:00100000:0.0:1789048461.066573:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789048461.066583:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:9491:x1875953111307520:12345-0@lo:101: 00010000:00010000:0.0:1789048461.066599:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048461.066615:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c00031000/0x133f221c08775cbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775cb8 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048461.066639:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c00031000/0x133f221c08775cbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775cb8 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048461.066650:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c00031000/0x133f221c08775cbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775cb8 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048461.066659:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c00031000, rc 0) 00000100:00100000:0.0:1789048461.066718:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:9491:x1875953111307520:12345-0@lo:101: Request processed in 136us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048461.066734:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789048461.067040:0:9491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111307520:0@lo:101: 00010000:00010000:2.0:1789048461.067582:0:9491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775cb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775cbf expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048461.067656:0:9491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775cb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775cbf expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048461.067761:0:9491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111307648:0@lo:501: 00000100:00100000:2.0:1789048461.067798:0:9491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048461.067825:0:9491:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0745ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789048461.068480:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111307648 00000100:00100000:0.0:1789048461.068488:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111307648 00000100:00100000:0.0:1789048461.068538:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789048461.068547:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:9491:x1875953111307648:12345-0@lo:501: 00000100:00100000:0.0:1789048461.068677:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:9491:x1875953111307648:12345-0@lo:501: Request processed in 131us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048461.068685:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789048461.068721:0:9491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111307648:0@lo:501: 00000100:00100000:3.0:1789048461.068754:0:9491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111307776:0@lo:503: 00000100:00100000:3.0:1789048461.068799:0:9491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048461.068832:0:9491:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06980a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789048461.068868:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111307776 00000100:00100000:2.0:1789048461.068873:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111307776 00000100:00100000:2.0:1789048461.068962:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789048461.068970:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:9491:x1875953111307776:12345-0@lo:503: 00000100:00100000:2.0:1789048461.069051:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:9491:x1875953111307776:12345-0@lo:503: Request processed in 81us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048461.069129:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789048461.069235:0:9491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111307776:0@lo:503: 00000040:00080000:1.0:1789048461.070636:0:9491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789048461.070911:0:9491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111307904:0@lo:502: 00000100:00100000:1.0:1789048461.070968:0:9491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048461.071009:0:9491:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2aed7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789048461.071751:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111307904 00000100:00100000:3.0:1789048461.071759:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111307904 00000100:00100000:3.0:1789048461.071799:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789048461.071815:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:9491:x1875953111307904:12345-0@lo:502: 00000100:00100000:3.0:1789048461.072721:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:9491:x1875953111307904:12345-0@lo:502: Request processed in 904us (1749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048461.072730:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789048461.073535:0:9491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111307904:0@lo:502: 00000040:00080000:1.0:1789048461.073777:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789048461.073807:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789048461.073962:0:9491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111308032:0@lo:502: 00000100:00100000:1.0:1789048461.074026:0:9491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048461.074069:0:9491:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2aed7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789048461.074181:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111308032 00000100:00100000:2.0:1789048461.074188:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111308032 00000100:00100000:2.0:1789048461.074228:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789048461.074236:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:9491:x1875953111308032:12345-0@lo:502: 00000100:00100000:2.0:1789048461.074361:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:9491:x1875953111308032:12345-0@lo:502: Request processed in 126us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048461.074369:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789048461.074537:0:9491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111308032:0@lo:502: 00000040:00080000:1.0:1789048461.074591:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789048461.074600:0:9491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789048461.075700:0:9507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048461.075711:0:9507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048461.075713:0:9507:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789048461.075719:0:9507:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959b06952000 00000020:00000080:3.0:1789048461.075722:0:9507:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789048461.075733:0:9507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048461.075736:0:9507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048461.075737:0:9507:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789048461.075740:0:9507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789048461.075990:0:9491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789048461.076017:0:9491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789048461.076041:0:9491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775cb8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775cbf expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048461.076055:0:9491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775cb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775cbf expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048461.076100:0:9491:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789048461.076103:0:9491:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff959b06952000 10000000:01000000:1.0:1789048461.076106:0:9491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff959b06952000 10000000:01000000:1.0:1789048461.076110:0:9491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789048461.076115:0:9491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959b06952000 from 1 10000000:01000000:1.0:1789048461.076117:0:9491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789048461.076147:0:9491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775cc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048461.076155:0:9491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775cc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048461.076165:0:9491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775cc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048461.076184:0:9491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111308160:0@lo:101: 00000100:00100000:1.0:1789048461.076232:0:9491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048461.076269:0:9491:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2aed7240 going to sleep for 11 seconds 00000100:00100000:2.0:1789048461.077071:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111308160 00000100:00100000:2.0:1789048461.077083:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111308160 00000100:00100000:2.0:1789048461.077130:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789048461.077138:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:9491:x1875953111308160:12345-0@lo:101: 00010000:00010000:2.0:1789048461.077152:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048461.077166:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c02836c00/0x133f221c08775ccd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775cc6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048461.077188:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c02836c00/0x133f221c08775ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775cc6 expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048461.077198:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c02836c00/0x133f221c08775ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775cc6 expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048461.077207:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02836c00, rc 0) 00000100:00100000:2.0:1789048461.077245:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:9491:x1875953111308160:12345-0@lo:101: Request processed in 108us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048461.077251:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789048461.077446:0:9491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111308160:0@lo:101: 00010000:00010000:1.0:1789048461.077462:0:9491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775cc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775ccd expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048461.077471:0:9491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775cc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775ccd expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048461.077571:0:9491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111308288:0@lo:501: 00000100:00100000:2.0:1789048461.077718:0:9491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048461.077748:0:9491:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2aed7240 going to sleep for 11 seconds 00000100:00100000:1.0:1789048461.077918:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111308288 00000100:00100000:1.0:1789048461.077924:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111308288 00000100:00100000:1.0:1789048461.077957:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789048461.077965:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:9491:x1875953111308288:12345-0@lo:501: 00000100:00100000:1.0:1789048461.078069:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:9491:x1875953111308288:12345-0@lo:501: Request processed in 104us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048461.078076:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789048461.079143:0:9491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111308288:0@lo:501: 00000100:00100000:0.0:1789048461.079186:0:9491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06971880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111308416:0@lo:503: 00000100:00100000:0.0:1789048461.079239:0:9491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048461.079283:0:9491:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b069769c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048461.079641:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111308416 00000100:00100000:1.0:1789048461.079647:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111308416 00000100:00100000:1.0:1789048461.079692:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789048461.079700:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:9491:x1875953111308416:12345-0@lo:503: 00000100:00100000:1.0:1789048461.079812:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:9491:x1875953111308416:12345-0@lo:503: Request processed in 112us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048461.079820:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789048461.080182:0:9491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06971880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111308416:0@lo:503: 00000040:00080000:0.0:1789048461.080436:0:9491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789048461.081770:0:9491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06971880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111308544:0@lo:502: 00000100:00100000:0.0:1789048461.081831:0:9491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048461.081874:0:9491:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b069769c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048461.082136:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111308544 00000100:00100000:3.0:1789048461.082143:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111308544 00000100:00100000:3.0:1789048461.082178:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789048461.082186:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:9491:x1875953111308544:12345-0@lo:502: 00000100:00100000:3.0:1789048461.082297:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:9491:x1875953111308544:12345-0@lo:502: Request processed in 112us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048461.082305:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789048461.083140:0:9491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06971880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111308544:0@lo:502: 00000040:00080000:0.0:1789048461.083424:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789048461.083459:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789048461.083486:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789048461.083512:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789048461.083528:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789048461.083543:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789048461.083559:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789048461.083573:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789048461.085142:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789048461.085187:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789048461.085205:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789048461.085220:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789048461.085255:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789048461.085273:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789048461.085288:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789048461.085304:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789048461.085321:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789048461.085354:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789048461.085380:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789048461.085396:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789048461.085412:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789048461.085425:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789048461.085440:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789048461.085453:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789048461.085479:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789048461.085491:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789048461.085517:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789048461.085534:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1789048461.085561:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789048461.085578:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1789048461.085606:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1789048461.085621:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1789048461.085635:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1789048461.085649:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1789048461.085664:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1789048461.085678:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1789048461.085693:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1789048461.085707:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1789048461.085721:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1789048461.085737:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1789048461.085751:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1789048461.085766:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1789048461.085780:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1789048461.085792:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1789048461.085816:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1789048461.085833:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1789048461.085877:0:9491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06971880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111308672:0@lo:502: 00000100:00100000:0.0:1789048461.085953:0:9491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048461.086001:0:9491:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06976d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789048461.087127:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111308672 00000100:00100000:3.0:1789048461.087139:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111308672 00000100:00100000:3.0:1789048461.087198:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789048461.087208:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:9491:x1875953111308672:12345-0@lo:502: 00000100:00100000:3.0:1789048461.087373:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:9491:x1875953111308672:12345-0@lo:502: Request processed in 166us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048461.087380:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789048461.087440:0:9491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06971880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111308672:0@lo:502: 00000040:00080000:3.0:1789048461.087535:0:9491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1789048461.087546:0:9491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1789048461.094760:0:9508:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789048461.094779:0:9508:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff959c3ef7cd40) 00000020:00000080:2.0:1789048461.094805:0:9508:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1789048461.094886:0:9508:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959b06952000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789048461.094890:0:9508:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959b06952000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789048461.094893:0:9508:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959b06952000 3 00010000:00080000:2.0:1789048461.094922:0:9508:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959b0758e800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.116@tcp at head 00010000:00010000:2.0:1789048461.096565:0:9508:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1789048461.105400:0:9508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789048461.105448:0:9508:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789048461.105461:0:9508:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x133f221c08775cdb 00000100:00080000:2.0:1789048461.105489:0:9508:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789048461.105508:0:9508:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff959b0758e800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048461.105542:0:9508:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c03e54380 x1875953111308800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789048461.105565:0:9508:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789048461.105840:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111308800:0@lo:38: 00000100:00100000:3.0:1789048461.105916:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048461.105992:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111308800 00000100:00100000:1.0:1789048461.105999:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111308800 00000100:00100000:1.0:1789048461.106041:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789048461.106048:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1875953111308800:12345-0@lo:38: 00010000:00080000:1.0:1789048461.106071:0:6498:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:1.0:1789048461.106118:0:6498:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x133f221c08775ce2 00000004:00100000:1.0:1789048461.106132:0:6498:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789048461.106167:0:6498:0:(import.c:65:import_set_state_nolock()) ffff959b06b55000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789048461.106223:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875953111308800:12345-0@lo:38: Request processed in 173us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048461.106230:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789048461.106270:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c03e54380 x1875953111308800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789048471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048461.106281:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789048461.106289:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789048461.106295:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789048461.106299:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789048461.106301:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b0758e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789048461.106307:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111308800:0@lo:38: 00000020:01000004:2.0:1789048461.106962:0:9508:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789048461.106986:0:9508:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff959b079219c0) 00000020:00000080:2.0:1789048461.107006:0:9508:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1789048461.107085:0:9508:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959b06952000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789048461.107089:0:9508:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959b06952000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789048461.107092:0:9508:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959b06952000 3 00010000:00080000:2.0:1789048461.107117:0:9508:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959b07588000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.116@tcp at head 00000100:00100000:3.0:1789048461.107725:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9509:1875953111308928:0@lo:901: 00000100:00100000:3.0:1789048461.107771:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048461.107799:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06980f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789048461.108393:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111308928 00000100:00100000:2.0:1789048461.108403:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111308928 00000100:00100000:2.0:1789048461.108471:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789048461.109270:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9509:x1875953111308928:12345-0@lo:901: 00000100:00100000:2.0:1789048461.109420:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9509:x1875953111308928:12345-0@lo:901: Request processed in 156us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048461.109427:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789048461.109559:0:9509:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b0747f800 x1875953111308928/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789048477 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048461.109575:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9509:1875953111308928:0@lo:901: 00000100:00080000:1.0:1789048461.110083:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789048461.115837:0:9508:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1789048461.116042:0:9508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789048461.116199:0:9508:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789048461.116212:0:9508:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x133f221c08775cf0 00000100:00080000:2.0:1789048461.116222:0:9508:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789048461.116233:0:9508:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff959b07588000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048461.116278:0:9508:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c03e55500 x1875953111309056/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789048461.116298:0:9508:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789048461.116623:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3619:1875953111309056:0@lo:38: 00000100:00100000:3.0:1789048461.116683:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048461.116734:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111309056 00000100:00100000:3.0:1789048461.116741:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111309056 00000100:00100000:3.0:1789048461.116776:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789048461.116783:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111309056:12345-0@lo:38: 00010000:00080000:3.0:1789048461.116808:0:6497:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:3.0:1789048461.116839:0:6497:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x133f221c08775cf7 00000004:00100000:3.0:1789048461.116852:0:6497:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789048461.116881:0:6497:0:(import.c:65:import_set_state_nolock()) ffff959c3fb21800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789048461.116942:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875953111309056:12345-0@lo:38: Request processed in 157us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048461.116949:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789048461.116985:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c03e55500 x1875953111309056/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789048471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048461.116995:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789048461.117003:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789048461.117009:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789048461.117013:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789048461.117020:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b07588000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789048461.117025:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3619:1875953111309056:0@lo:38: 00000040:00080000:2.0:1789048461.117750:0:9508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1789048461.117810:0:9491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1789048461.117840:0:9491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789048461.117856:0:9491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775cc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775ccd expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048461.117867:0:9491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775cc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775ccd expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789048461.117917:0:9491:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789048461.117919:0:9491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789048461.117921:0:9491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048461.117922:0:9491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048461.117923:0:9491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048461.117925:0:9491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048461.117926:0:9491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789048461.117928:0:9491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789048461.117929:0:9491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789048461.117931:0:9491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048461.117933:0:9491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789048461.117936:0:9491:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789048461.117938:0:9491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789048461.117940:0:9491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789048461.117941:0:9491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048461.117942:0:9491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048461.117943:0:9491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048461.117944:0:9491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048461.117945:0:9491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789048461.117946:0:9491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789048461.117947:0:9491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789048461.117948:0:9491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048461.117949:0:9491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789048461.117965:0:9491:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789048461.117977:0:9491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111309184:0@lo:253: 00000100:00100000:2.0:1789048461.118021:0:9491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048461.118048:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111309184 00000100:00100000:2.0:1789048461.121299:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111309184 00000100:00100000:2.0:1789048461.121375:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789048461.121385:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:9491:x1875953111309184:12345-0@lo:253: 20000000:01000000:2.0:1789048461.121415:0:6490:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789048461.121428:0:6490:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789048461.121569:0:9491:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0745fa80 going to sleep for 11 seconds 20000000:01000000:2.0:1789048461.134702:0:6490:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789048461.134723:0:6490:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789048461.135199:0:6513:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789048461.135204:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789048461.135227:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff959c3ef3ca00/0x133f221c08775cfe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.135244:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c0147b800/0x133f221c08775bf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775bed expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.135252:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c02837400/0x133f221c08775c3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775c33 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.135259:0:6513:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959c3ef3ca00/0x133f221c08775cfe lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.135295:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c02837400/0x133f221c08775c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775c33 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.135308:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c02837400/0x133f221c08775c3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775c33 expref: 17 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048461.135320:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875953111309312:0@lo:104: 00000100:00100000:3.0:1789048461.135401:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789048461.135457:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c0147b800/0x133f221c08775bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775bed expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.135466:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c0147b800/0x133f221c08775bf4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775bed expref: 17 pid: 6491 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048461.135832:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111309312 00000100:00100000:2.0:1789048461.135840:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111309312 00000100:00100000:2.0:1789048461.135888:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789048461.135960:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:9491:x1875953111309184:12345-0@lo:253: Request processed in 14576us (17937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048461.135979:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789048461.136992:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:6513:x1875953111309312:12345-0@lo:104: 00010000:00010000:2.0:1789048461.137012:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775c3a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048461.137144:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789048461.137151:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:6513:x1875953111309312:12345-0@lo:104: Request processed in 1255us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048461.137159:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789048461.137213:0:9491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9491:1875953111309184:0@lo:253: 10000000:01000000:2.0:1789048461.137226:0:9491:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789048461.137229:0:9491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789048461.137231:0:9491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789048461.137232:0:9491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048461.137233:0:9491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048461.137234:0:9491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048461.137236:0:9491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048461.137237:0:9491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789048461.137238:0:9491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789048461.137240:0:9491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789048461.137241:0:9491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048461.137242:0:9491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789048461.137264:0:9491:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1789048461.137445:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048461.137452:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775c3a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048461.137461:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837600 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:0.0:1789048461.137465:0:7447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775c3a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048461.137474:0:7447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775c3a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048461.137481:0:7447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775c3a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048461.137488:0:7447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789048461.137537:0:7447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775c33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775c3a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048461.137543:0:7447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789048461.137568:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775c33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775c3a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048461.137576:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775c33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775c3a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048461.137589:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048461.137590:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048461.137592:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048461.138040:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875953111309440:0@lo:104: 00000100:00100000:3.0:1789048461.138099:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048461.138134:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06980480 going to sleep for 11 seconds 00000100:00100000:3.0:1789048461.138148:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875953111309312:0@lo:104: 00000100:00100000:3.0:1789048461.138168:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111309440 00000100:00100000:3.0:1789048461.138174:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111309440 00000100:00100000:3.0:1789048461.138212:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789048461.138218:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:6513:x1875953111309440:12345-0@lo:104: 00010000:00010000:3.0:1789048461.138228:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c013d7200/0x133f221c08775bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775bf4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.138270:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789048461.138275:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:6513:x1875953111309440:12345-0@lo:104: Request processed in 57us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048461.138280:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1789048461.138297:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048461.138302:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c013d7200/0x133f221c08775bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775bf4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.138308:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c013d7200 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:3.0:1789048461.138311:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c013d7200/0x133f221c08775bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775bf4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.138319:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c013d7200/0x133f221c08775bed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775bf4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789048461.138326:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c013d7200/0x133f221c08775bed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775bf4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048461.138349:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789048461.138373:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c013d7200/0x133f221c08775bed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775bf4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.138379:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789048461.138394:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c013d7200/0x133f221c08775bed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775bf4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.138400:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c013d7200/0x133f221c08775bed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775bf4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.138416:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048461.138417:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048461.138419:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048461.138430:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111309696:0@lo:103: 00000100:00100000:3.0:1789048461.138454:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048461.138509:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111309696 00000100:00100000:3.0:1789048461.138519:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875953111309440:0@lo:104: 00000100:00100000:0.0:1789048461.138519:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111309696 00010000:00010000:3.0:1789048461.138535:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff959c3ef3ca00/0x133f221c08775cfe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048461.138536:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c0147b800/0x133f221c08775bf4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775bed expref: 17 pid: 6491 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048461.138558:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789048461.138565:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:3620:x1875953111309696:12345-0@lo:103: 00010000:00010000:0.0:1789048461.138577:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048461.138582:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c0147b800/0x133f221c08775bf4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775bed expref: 17 pid: 6491 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048461.138590:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c0147b800/0x133f221c08775bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775bed expref: 17 pid: 6491 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048461.138602:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c0147b800/0x133f221c08775bf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775bed expref: 17 pid: 6491 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048461.138614:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048461.138650:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:3620:x1875953111309696:12345-0@lo:103: Request processed in 86us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048461.138656:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789048461.138983:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111309696:0@lo:103: 00000100:00100000:0.0:1789048461.139445:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789048461.139457:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111309568:0@lo:103: 00000100:00100000:0.0:1789048461.139493:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048461.139571:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111309568 00000100:00100000:3.0:1789048461.139577:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111309568 00010000:00010000:3.0:1789048461.139666:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c02837400/0x133f221c08775c3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775c33 expref: 16 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048461.139693:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789048461.139699:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06973b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:3622:x1875953111309568:12345-0@lo:103: 00010000:00010000:3.0:1789048461.139709:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048461.139713:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c02837400/0x133f221c08775c3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775c33 expref: 16 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.139729:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c02837400/0x133f221c08775c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775c33 expref: 16 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.139742:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c02837400/0x133f221c08775c3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775c33 expref: 16 pid: 6490 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.139757:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959c3ef3ca00/0x133f221c08775cfe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.139765:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3ca00/0x133f221c08775cfe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789048461.139778:0:6481:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007010859s 00010000:00010000:3.0:1789048461.139784:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef3ca00/0x133f221c08775cfe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.139791:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef3ca00/0x133f221c08775cfe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.139797:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff959c3ef3ca00/0x133f221c08775cfe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.139804:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff959c3ef3ca00/0x133f221c08775cfe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.139810:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3ca00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048461.139814:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff959c3ef3ca00/0x133f221c08775cfe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.139821:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff959c3ef3ca00/0x133f221c08775cfe lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.139842:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff959c3ef3ca00/0x133f221c08775cfe lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.139851:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048461.139884:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06973b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:3622:x1875953111309568:12345-0@lo:103: Request processed in 184us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048461.139891:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789048461.141026:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111309568:0@lo:103: 00010000:00010000:3.0:1789048461.141166:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff959c3ef3ca00/0x133f221c08775cfe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.141177:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff959c3ef3ca00/0x133f221c08775cfe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048461.141183:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3ca00/0x133f221c08775cfe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1789048461.150888:0:9491:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789048461.151088:0:9491:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789048461.151284:0:9491:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789048461.151462:0:9491:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789048461.151698:0:9491:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789048461.151944:0:9491:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1789048461.157148:0:9491:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789048461.181182:0:9491:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789048461.181191:0:9491:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789048461.181230:0:9491:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789048461.181279:0:9491:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789048461.181300:0:9491:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789048461.181323:0:9491:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1789048461.182842:0:9491:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789048461.183790:0:9491:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1789048461.277566:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048461.789690:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111309824:0@lo:41: 00000100:00100000:0.0:1789048461.789760:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048461.789841:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111309824 00000100:00100000:3.0:1789048461.789850:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111309824 00000100:00100000:3.0:1789048461.789908:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789048461.789917:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111309824:12345-0@lo:41: 00000004:00000024:3.0:1789048461.789949:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789048461.789996:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111309824:12345-0@lo:41: Request processed in 81us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048461.790003:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789048461.790019:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111309824:0@lo:41: 00000020:00000004:0.0:1789048462.283557:0:9564:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789048462.284186:0:9564:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789048462.311530:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048463.325497:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048464.355197:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048465.373485:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789048465.373522:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111309952:0@lo:41: 00000100:00100000:0.0:1789048465.373600:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048465.373676:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111309952 00000100:00100000:0.0:1789048465.373685:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111309952 00000100:00100000:0.0:1789048465.373729:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789048465.373738:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111309952:12345-0@lo:41: 00000004:00000024:0.0:1789048465.373772:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1789048465.373815:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111309952:12345-0@lo:41: Request processed in 78us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048465.373822:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789048465.373866:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111309952:0@lo:41: 00010000:00010000:1.0:1789048465.377391:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048465.885584:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789048465.885611:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111310080:0@lo:13: 00000100:00100000:2.0:1789048465.885683:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048465.885924:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111310080 00000100:00100000:3.0:1789048465.885933:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111310080 00000100:00100000:3.0:1789048465.886001:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789048465.886012:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111310080:12345-0@lo:13: 00002000:00000024:3.0:1789048465.886040:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048465.886171:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111310080:12345-0@lo:13: Request processed in 161us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048465.886178:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789048465.886217:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0747e680 x1875953111310080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048465.886234:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111310080:0@lo:13: 00000100:00080000:0.0:1789048465.886370:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789048465.888448:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111310208:0@lo:13: 00000100:00100000:0.0:1789048465.888652:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048465.889086:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111310208 00000100:00100000:3.0:1789048465.889095:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111310208 00000100:00100000:3.0:1789048465.889157:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789048465.889166:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06970700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111310208:12345-0@lo:13: 00002000:00000024:3.0:1789048465.889187:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048465.889234:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06970700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111310208:12345-0@lo:13: Request processed in 69us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048465.889241:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789048465.889267:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789048465.889470:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b06972a00 x1875953111310208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048465.889489:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111310208:0@lo:13: 00010000:00010000:3.0:1789048466.397861:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048466.399445:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111310592:0@lo:400: 00000100:00100000:1.0:1789048466.399538:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048466.399589:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111311104:0@lo:400: 00000100:00100000:1.0:1789048466.399614:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048466.399636:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111311616:0@lo:400: 00000100:00100000:1.0:1789048466.399657:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048466.399683:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789048466.399689:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111310464:0@lo:400: 00000100:00100000:1.0:1789048466.399708:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048466.399734:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875953111310976:0@lo:400: 00000100:00100000:1.0:1789048466.399755:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048466.399770:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111311488:0@lo:400: 00000100:00100000:3.0:1789048466.399943:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111310720:0@lo:400: 00000100:00100000:3.0:1789048466.399974:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048466.399987:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111311232:0@lo:400: 00000100:00100000:3.0:1789048466.400009:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048466.400049:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789048466.400055:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111310336:0@lo:400: 00000100:00100000:3.0:1789048466.400096:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048466.400119:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111310848:0@lo:400: 00000100:00100000:3.0:1789048466.400141:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048466.400159:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111311360:0@lo:400: 00000100:00100000:3.0:1789048466.400181:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048466.400215:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111310592 00000100:00100000:3.0:1789048466.400222:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111310592 00000100:00100000:3.0:1789048466.400265:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111310848 00000100:00100000:3.0:1789048466.400269:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111310848 00000100:00100000:3.0:1789048466.400286:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789048466.400294:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111310592:12345-0@lo:400: 00000100:00100000:3.0:1789048466.400367:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111310592:12345-0@lo:400: Request processed in 73us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048466.400374:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789048466.400392:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789048466.400399:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111310848:12345-0@lo:400: 00000100:00100000:3.0:1789048466.400434:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111310848:12345-0@lo:400: Request processed in 35us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048466.400440:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789048466.400471:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111311104 00000100:00100000:3.0:1789048466.400475:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111311104 00000100:00100000:3.0:1789048466.400518:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111311616 00000100:00100000:3.0:1789048466.400522:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111311616 00000100:00100000:3.0:1789048466.400535:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111310464 00000100:00100000:3.0:1789048466.400538:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111310464 00000100:00100000:3.0:1789048466.400548:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111310976 00000100:00100000:3.0:1789048466.400551:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111310976 00000100:00100000:3.0:1789048466.400576:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111310720 00000100:00100000:3.0:1789048466.400579:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111310720 00000100:00100000:3.0:1789048466.400594:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789048466.400600:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111311104:12345-0@lo:400: 00000100:00100000:3.0:1789048466.400635:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111311104:12345-0@lo:400: Request processed in 35us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048466.400641:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789048466.400652:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789048466.400658:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111311616:12345-0@lo:400: 00000100:00100000:3.0:1789048466.400687:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111311616:12345-0@lo:400: Request processed in 29us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048466.400692:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789048466.400704:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789048466.400710:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111310464:12345-0@lo:400: 00000100:00100000:3.0:1789048466.400738:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111310464:12345-0@lo:400: Request processed in 28us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048466.400743:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789048466.400754:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789048466.400760:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875953111310976:12345-0@lo:400: 00000100:00100000:3.0:1789048466.400801:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875953111310976:12345-0@lo:400: Request processed in 41us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048466.400807:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789048466.400819:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789048466.400825:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111310720:12345-0@lo:400: 00000100:00100000:3.0:1789048466.400852:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111310720:12345-0@lo:400: Request processed in 27us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048466.400866:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789048466.401405:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111311232 00000100:00100000:3.0:1789048466.401411:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111311232 00000100:00100000:3.0:1789048466.401443:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111311360 00000100:00100000:3.0:1789048466.401447:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111311360 00000100:00100000:3.0:1789048466.401480:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789048466.401487:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111311232:12345-0@lo:400: 00000100:00100000:3.0:1789048466.401583:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111311232:12345-0@lo:400: Request processed in 96us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048466.401589:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789048466.401601:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789048466.401608:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111311360:12345-0@lo:400: 00000100:00100000:3.0:1789048466.401632:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111311360:12345-0@lo:400: Request processed in 25us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048466.401637:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789048466.401656:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048466.401661:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048466.401709:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111310848:0@lo:400: 00010000:00080000:3.0:1789048466.401724:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07bf3100 x1875953111311360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048466.401735:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111311360:0@lo:400: 00010000:00080000:3.0:1789048466.401747:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07bf3b80 x1875953111310720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048466.401754:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111310720:0@lo:400: 00010000:00080000:3.0:1789048466.401763:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07bf0700 x1875953111311232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048466.402022:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111311232:0@lo:400: 00000100:00100000:1.0:1789048466.402205:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048466.402249:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111310592:0@lo:400: 00010000:00080000:1.0:1789048466.402261:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07bf3480 x1875953111311104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048466.402269:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111311104:0@lo:400: 00010000:00080000:1.0:1789048466.402279:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07bf2680 x1875953111311616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048466.402287:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111311616:0@lo:400: 00010000:00080000:1.0:1789048466.402309:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c2b613100 x1875953111310464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048466.402317:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111310464:0@lo:400: 00010000:00080000:1.0:1789048466.402328:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07bf2a00 x1875953111310976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048466.402351:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875953111310976:0@lo:400: 00000100:00100000:1.0:1789048466.402375:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111311488 00000100:00100000:1.0:1789048466.402380:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111311488 00000100:00100000:1.0:1789048466.402415:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789048466.402422:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111311488:12345-0@lo:400: 00000100:00100000:1.0:1789048466.402477:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111311488:12345-0@lo:400: Request processed in 54us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048466.402483:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789048466.402530:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111310336 00000100:00100000:1.0:1789048466.402535:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111310336 00000100:00100000:1.0:1789048466.402559:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789048466.402566:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:3620:x1875953111310336:12345-0@lo:400: 00000100:00100000:1.0:1789048466.402601:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:3620:x1875953111310336:12345-0@lo:400: Request processed in 35us (2504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048466.402607:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00010000:00080000:1.0:1789048466.402644:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07bf0a80 x1875953111311488/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048466.402653:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111311488:0@lo:400: 00000100:00080000:3.0:1789048466.402801:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048466.402821:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111310336:0@lo:400: 00000100:00100000:0.0:1789048466.912508:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789048466.912534:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111311744:0@lo:41: 00000100:00100000:0.0:1789048466.912598:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048466.912668:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111311744 00000100:00100000:0.0:1789048466.912675:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111311744 00000100:00100000:0.0:1789048466.912718:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789048466.912726:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111311744:12345-0@lo:41: 00000004:00000024:0.0:1789048466.912758:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789048466.912812:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111311744:12345-0@lo:41: Request processed in 86us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048466.912831:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789048466.912884:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111311744:0@lo:41: 00010000:00010000:2.0:1789048467.438324:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789048468.211695:0:9854:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789048468.448503:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789048469.469490:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789048469.469499:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959c41779800 from 39 10000000:01000000:3.0:1789048469.469504:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789048469.469555:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c08775d05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048469.469568:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c08775d05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048469.469580:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c08775d05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048469.469605:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111311872:0@lo:101: 00000100:00100000:3.0:1789048469.469685:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048469.469752:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef21300 going to sleep for 11 seconds 00010000:00010000:3.0:1789048469.469795:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048469.469941:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111311872 00000100:00100000:0.0:1789048469.469949:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111311872 00000100:00100000:0.0:1789048469.470001:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789048469.470012:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:6494:x1875953111311872:12345-0@lo:101: 00010000:00010000:0.0:1789048469.470026:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048469.470038:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c00031600/0x133f221c08775d0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775d05 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.470062:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c00031600/0x133f221c08775d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775d05 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.470072:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c00031600/0x133f221c08775d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775d05 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.470081:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c00031600, rc 0) 00000100:00100000:0.0:1789048469.470128:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:6494:x1875953111311872:12345-0@lo:101: Request processed in 119us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.470134:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789048469.470325:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111311872:0@lo:101: 00010000:00010000:3.0:1789048469.470358:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c08775d05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d0c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048469.470368:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c08775d05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775d0c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048469.470456:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111312000:0@lo:501: 00000100:00100000:3.0:1789048469.470493:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048469.470520:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef21300 going to sleep for 11 seconds 00000100:00100000:0.0:1789048469.470575:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111312000 00000100:00100000:0.0:1789048469.470580:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111312000 00000100:00100000:0.0:1789048469.470609:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789048469.470615:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:6494:x1875953111312000:12345-0@lo:501: 00000100:00100000:0.0:1789048469.470738:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:6494:x1875953111312000:12345-0@lo:501: Request processed in 122us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.470745:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789048469.470960:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111312000:0@lo:501: 00000100:00100000:3.0:1789048469.470986:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111312128:0@lo:503: 00000100:00100000:3.0:1789048469.471024:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048469.471045:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef21300 going to sleep for 11 seconds 00000100:00100000:1.0:1789048469.471101:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111312128 00000100:00100000:1.0:1789048469.471106:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111312128 00000100:00100000:1.0:1789048469.471137:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789048469.471145:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:6494:x1875953111312128:12345-0@lo:503: 00000100:00100000:1.0:1789048469.471242:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:6494:x1875953111312128:12345-0@lo:503: Request processed in 98us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048469.471249:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789048469.471772:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111312128:0@lo:503: 00000100:00100000:3.0:1789048469.472825:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9887:1875953111312256:0@lo:502: 00000100:00100000:3.0:1789048469.472884:0:9887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048469.472924:0:9887:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef21840 going to sleep for 11 seconds 00000100:00100000:2.0:1789048469.472979:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111312256 00000100:00100000:2.0:1789048469.472986:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111312256 00000100:00100000:2.0:1789048469.473026:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789048469.473034:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:9887:x1875953111312256:12345-0@lo:502: 00000100:00100000:2.0:1789048469.473157:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:9887:x1875953111312256:12345-0@lo:502: Request processed in 124us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048469.473164:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789048469.473300:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9887:1875953111312256:0@lo:502: 00000100:00100000:3.0:1789048469.473382:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9887:1875953111312384:0@lo:502: 00000100:00100000:3.0:1789048469.473415:0:9887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048469.473442:0:9887:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef21840 going to sleep for 11 seconds 00000100:00100000:0.0:1789048469.473511:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111312384 00000100:00100000:0.0:1789048469.473516:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111312384 00000100:00100000:0.0:1789048469.473548:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789048469.473555:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:9887:x1875953111312384:12345-0@lo:502: 00000100:00100000:0.0:1789048469.473855:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:9887:x1875953111312384:12345-0@lo:502: Request processed in 300us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.473861:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789048469.475011:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9887:1875953111312384:0@lo:502: 00000040:00080000:3.0:1789048469.475045:0:9887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789048469.475616:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789048469.475650:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789048469.475661:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c08775d05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d0c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048469.475686:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c08775d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d0c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048469.475696:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789048469.475699:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789048469.475701:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789048469.475732:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775d13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048469.475739:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775d13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048469.475746:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775d13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048469.475763:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111312512:0@lo:101: 00000100:00100000:2.0:1789048469.475809:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048469.475840:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06980840 going to sleep for 11 seconds 00000100:00100000:3.0:1789048469.483790:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111312512 00000100:00100000:3.0:1789048469.483806:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111312512 00000100:00100000:3.0:1789048469.483867:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789048469.483876:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:6494:x1875953111312512:12345-0@lo:101: 00010000:00010000:3.0:1789048469.483893:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048469.483912:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef3da00/0x133f221c08775d1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775d13 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048469.483955:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3da00/0x133f221c08775d1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775d13 expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048469.483966:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef3da00/0x133f221c08775d1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775d13 expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048469.484188:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3da00, rc 0) 00000100:00100000:3.0:1789048469.484279:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111312512:12345-0@lo:101: Request processed in 404us (8469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048469.484286:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789048469.484400:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111312512:0@lo:101: 00010000:00010000:2.0:1789048469.484428:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775d13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d1a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048469.484439:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775d13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775d1a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048469.484524:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111312640:0@lo:501: 00000100:00100000:2.0:1789048469.484557:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048469.484598:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06980840 going to sleep for 11 seconds 00000100:00100000:3.0:1789048469.485156:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111312640 00000100:00100000:3.0:1789048469.485163:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111312640 00000100:00100000:3.0:1789048469.485204:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789048469.485212:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111312640:12345-0@lo:501: 00000100:00100000:3.0:1789048469.485724:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111312640:12345-0@lo:501: Request processed in 511us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048469.485733:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789048469.487487:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111312640:0@lo:501: 00000100:00100000:1.0:1789048469.487544:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111312768:0@lo:503: 00000100:00100000:1.0:1789048469.487609:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048469.487747:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2aed7300 going to sleep for 11 seconds 00000100:00100000:3.0:1789048469.488457:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111312768 00000100:00100000:3.0:1789048469.488477:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111312768 00000100:00100000:0.0:1789048469.488591:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789048469.488602:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111312768:12345-0@lo:503: 00000100:00100000:0.0:1789048469.488746:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111312768:12345-0@lo:503: Request processed in 145us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.488753:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789048469.488961:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111312768:0@lo:503: 00000100:00100000:2.0:1789048469.489505:0:9888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9888:1875953111312896:0@lo:502: 00000100:00100000:2.0:1789048469.489552:0:9888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048469.489582:0:9888:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06980480 going to sleep for 11 seconds 00000100:00100000:3.0:1789048469.489902:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111312896 00000100:00100000:3.0:1789048469.489909:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111312896 00000100:00100000:3.0:1789048469.489949:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789048469.489959:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:9888:x1875953111312896:12345-0@lo:502: 00000100:00100000:3.0:1789048469.490074:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:9888:x1875953111312896:12345-0@lo:502: Request processed in 116us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048469.490081:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789048469.490159:0:9888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9888:1875953111312896:0@lo:502: 00000020:01000000:2.0:1789048469.490184:0:9888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789048469.490193:0:9888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048469.490196:0:9888:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789048469.490201:0:9888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789048469.490203:0:9888:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789048469.490220:0:9888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9888:1875953111313024:0@lo:502: 00000100:00100000:2.0:1789048469.490253:0:9888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048469.490281:0:9888:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06980480 going to sleep for 11 seconds 00000100:00100000:0.0:1789048469.490364:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111313024 00000100:00100000:0.0:1789048469.490369:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111313024 00000100:00100000:0.0:1789048469.490399:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789048469.490406:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:9888:x1875953111313024:12345-0@lo:502: 00000100:00100000:0.0:1789048469.490520:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:9888:x1875953111313024:12345-0@lo:502: Request processed in 114us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.490526:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789048469.490611:0:9888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9888:1875953111313024:0@lo:502: 00000020:01000000:1.0:1789048469.490639:0:9888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048469.490649:0:9888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048469.490651:0:9888:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789048469.490655:0:9888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789048469.491870:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789048469.491902:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789048469.491914:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775d13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d1a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.491926:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775d13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d1a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048469.491937:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789048469.491952:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959c414c7000 from 39 10000000:01000000:0.0:1789048469.491954:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789048469.491984:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775d21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.491991:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775d21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.492001:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775d21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048469.492017:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111313152:0@lo:101: 00000100:00100000:0.0:1789048469.492062:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.492104:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb69480 going to sleep for 11 seconds 00000100:00100000:1.0:1789048469.492252:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111313152 00000100:00100000:1.0:1789048469.492259:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111313152 00000100:00100000:1.0:1789048469.492309:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789048469.492317:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111313152:12345-0@lo:101: 00010000:00010000:1.0:1789048469.492329:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048469.492371:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c013d6800/0x133f221c08775d28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775d21 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048469.492393:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c013d6800/0x133f221c08775d28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775d21 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048469.492403:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c013d6800/0x133f221c08775d28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775d21 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048469.492411:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c013d6800, rc 0) 00000100:00100000:1.0:1789048469.492455:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111313152:12345-0@lo:101: Request processed in 139us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048469.492461:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789048469.493808:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111313152:0@lo:101: 00010000:00010000:0.0:1789048469.493831:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775d21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d28 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.493843:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775d21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775d28 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048469.493911:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111313280:0@lo:501: 00000100:00100000:0.0:1789048469.493952:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.493986:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb69480 going to sleep for 11 seconds 00000100:00100000:1.0:1789048469.494053:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111313280 00000100:00100000:1.0:1789048469.494060:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111313280 00000100:00100000:1.0:1789048469.494103:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789048469.494112:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111313280:12345-0@lo:501: 00000100:00100000:1.0:1789048469.494243:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111313280:12345-0@lo:501: Request processed in 132us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048469.494250:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789048469.494375:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111313280:0@lo:501: 00000100:00100000:0.0:1789048469.494399:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111313408:0@lo:503: 00000100:00100000:0.0:1789048469.494453:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.494482:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb69480 going to sleep for 11 seconds 00000100:00100000:3.0:1789048469.494559:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111313408 00000100:00100000:3.0:1789048469.494569:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111313408 00000100:00100000:3.0:1789048469.494595:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789048469.494602:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111313408:12345-0@lo:503: 00000100:00100000:3.0:1789048469.494761:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111313408:12345-0@lo:503: Request processed in 159us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048469.494768:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789048469.495008:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111313408:0@lo:503: 00000100:00100000:2.0:1789048469.502973:0:9889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9889:1875953111313536:0@lo:502: 00000100:00100000:2.0:1789048469.503083:0:9889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048469.503129:0:9889:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06980240 going to sleep for 11 seconds 00000100:00100000:3.0:1789048469.503188:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111313536 00000100:00100000:3.0:1789048469.503196:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111313536 00000100:00100000:3.0:1789048469.503247:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789048469.503257:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:9889:x1875953111313536:12345-0@lo:502: 00000100:00100000:3.0:1789048469.503434:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:9889:x1875953111313536:12345-0@lo:502: Request processed in 177us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048469.503442:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789048469.503866:0:9889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9889:1875953111313536:0@lo:502: 00000100:00100000:0.0:1789048469.503921:0:9889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9889:1875953111313664:0@lo:502: 00000100:00100000:0.0:1789048469.503960:0:9889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.503991:0:9889:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb69480 going to sleep for 11 seconds 00000100:00100000:3.0:1789048469.504040:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111313664 00000100:00100000:3.0:1789048469.504045:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111313664 00000100:00100000:3.0:1789048469.504088:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789048469.504095:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:9889:x1875953111313664:12345-0@lo:502: 00000100:00100000:3.0:1789048469.504170:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:9889:x1875953111313664:12345-0@lo:502: Request processed in 75us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048469.504177:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789048469.504817:0:9889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9889:1875953111313664:0@lo:502: 00000040:00080000:0.0:1789048469.504843:0:9889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789048469.505394:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789048469.505417:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789048469.505437:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775d21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d28 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048469.505449:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d28 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048469.505474:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789048469.505476:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c414c7000 from 6 10000000:01000000:3.0:1789048469.505479:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789048469.505509:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d000/0x133f221c08775d2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048469.505516:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d000/0x133f221c08775d2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048469.505526:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d000/0x133f221c08775d2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048469.505541:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111313792:0@lo:101: 00000100:00100000:3.0:1789048469.505581:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048469.505607:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa6240 going to sleep for 11 seconds 00000100:00100000:2.0:1789048469.505887:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111313792 00000100:00100000:2.0:1789048469.505895:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111313792 00000100:00100000:2.0:1789048469.505940:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789048469.505950:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111313792:12345-0@lo:101: 00010000:00010000:2.0:1789048469.505962:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048469.505976:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c02837c00/0x133f221c08775d36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775d2f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048469.505997:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c02837c00/0x133f221c08775d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775d2f expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048469.506007:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c02837c00/0x133f221c08775d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775d2f expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048469.506025:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02837c00, rc 0) 00000100:00100000:2.0:1789048469.506071:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:6494:x1875953111313792:12345-0@lo:101: Request processed in 122us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048469.506077:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789048469.509569:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111313792:0@lo:101: 00010000:00010000:3.0:1789048469.509600:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d000/0x133f221c08775d2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d36 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048469.509614:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d000/0x133f221c08775d2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775d36 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048469.509702:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111313920:0@lo:256: 00000100:00100000:3.0:1789048469.509767:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048469.509808:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa6240 going to sleep for 11 seconds 00000100:00100000:0.0:1789048469.510761:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111313920 00000100:00100000:0.0:1789048469.510772:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111313920 00000100:00100000:0.0:1789048469.510826:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789048469.510836:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:6494:x1875953111313920:12345-0@lo:256: 20000000:01000000:0.0:1789048469.510858:0:6490:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789048469.510878:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789048469.510881:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789048469.510978:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:6494:x1875953111313920:12345-0@lo:256: Request processed in 144us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.510986:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789048469.512025:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111313920:0@lo:256: 10000000:01000000:3.0:1789048469.512089:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789048469.512105:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d000/0x133f221c08775d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d36 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048469.512116:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d000/0x133f221c08775d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d36 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048469.512126:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789048469.512129:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1789048469.512132:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789048469.512160:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c08775d3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048469.512167:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c08775d3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048469.512175:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c08775d3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048469.512192:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111314048:0@lo:101: 00000100:00100000:3.0:1789048469.512230:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048469.512259:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa6240 going to sleep for 11 seconds 00000100:00100000:2.0:1789048469.512755:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111314048 00000100:00100000:2.0:1789048469.512762:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111314048 00000100:00100000:2.0:1789048469.512810:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789048469.512820:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:6494:x1875953111314048:12345-0@lo:101: 00010000:00010000:2.0:1789048469.512832:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048469.512845:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c02836a00/0x133f221c08775d44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775d3d expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048469.512866:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c02836a00/0x133f221c08775d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775d3d expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048469.512874:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c02836a00/0x133f221c08775d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775d3d expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048469.512881:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02836a00, rc 0) 00000100:00100000:2.0:1789048469.512913:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:6494:x1875953111314048:12345-0@lo:101: Request processed in 96us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048469.512920:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789048469.513163:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111314048:0@lo:101: 00010000:00010000:3.0:1789048469.513176:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c08775d3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d44 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048469.513185:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c08775d3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775d44 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048469.513242:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111314176:0@lo:501: 00000100:00100000:3.0:1789048469.513285:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048469.513308:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa6240 going to sleep for 11 seconds 00000100:00100000:3.0:1789048469.513320:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111314176 00000100:00100000:3.0:1789048469.513324:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111314176 00000100:00100000:3.0:1789048469.516985:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789048469.517001:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:6494:x1875953111314176:12345-0@lo:501: 00000100:00100000:3.0:1789048469.517173:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:6494:x1875953111314176:12345-0@lo:501: Request processed in 176us (3887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048469.517182:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789048469.517243:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111314176:0@lo:501: 00000100:00100000:3.0:1789048469.517292:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111314304:0@lo:503: 00000100:00100000:3.0:1789048469.517365:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048469.517392:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa6240 going to sleep for 11 seconds 00000100:00100000:0.0:1789048469.518365:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111314304 00000100:00100000:0.0:1789048469.518375:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111314304 00000100:00100000:0.0:1789048469.518428:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789048469.518437:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:6494:x1875953111314304:12345-0@lo:503: 00000100:00100000:0.0:1789048469.518562:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:6494:x1875953111314304:12345-0@lo:503: Request processed in 127us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.518570:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789048469.523823:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111314304:0@lo:503: 00000100:00100000:1.0:1789048469.527907:0:9891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9891:1875953111314432:0@lo:502: 00000100:00100000:1.0:1789048469.528001:0:9891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048469.528046:0:9891:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2aed7000 going to sleep for 11 seconds 00000100:00100000:0.0:1789048469.528108:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111314432 00000100:00100000:0.0:1789048469.528115:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111314432 00000100:00100000:0.0:1789048469.528177:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789048469.528197:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:9891:x1875953111314432:12345-0@lo:502: 00000100:00100000:0.0:1789048469.528329:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:9891:x1875953111314432:12345-0@lo:502: Request processed in 143us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.528377:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789048469.529791:0:9891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9891:1875953111314432:0@lo:502: 00000020:01000000:3.0:1789048469.529830:0:9891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789048469.529838:0:9891:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789048469.529844:0:9891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048469.529846:0:9891:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789048469.529851:0:9891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789048469.529855:0:9891:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:3.0:1789048469.529878:0:9891:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789048469.529881:0:9891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789048469.529906:0:9891:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff959b077e8000) 00000020:00000080:3.0:1789048469.529931:0:9891:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1789048469.529938:0:9891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789048469.530061:0:9891:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789048469.530069:0:9891:0:(osd_handler.c:8921:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789048469.530076:0:9891:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x133f221c08775d52 00010000:00080000:3.0:1789048469.530109:0:9891:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959c3fb24000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:3.0:1789048469.535735:0:9891:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1789048469.538863:0:9891:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789048469.538883:0:9891:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789048469.539056:0:9891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789048469.539171:0:9891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789048469.541714:0:9891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789048469.544666:0:9891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789048469.552214:0:9892:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789048469.552222:0:9892:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789048469.553119:0:9891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789048469.553132:0:9891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789048469.553173:0:9891:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789048469.553199:0:9891:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x133f221c08775d59 00000100:00080000:3.0:1789048469.553210:0:9891:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789048469.553221:0:9891:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff959c3fb24000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048469.553255:0:9891:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b0747f800 x1875953111314560/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789048469.553283:0:9891:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789048469.553364:0:9891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048469.553369:0:9891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048469.553370:0:9891:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789048469.553373:0:9891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048469.553377:0:9891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048469.553378:0:9891:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789048469.553381:0:9891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789048469.553383:0:9891:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789048469.553409:0:9891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9891:1875953111314688:0@lo:502: 00000100:00100000:3.0:1789048469.553513:0:9891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048469.553551:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111314688 00000100:00100000:3.0:1789048469.553559:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111314688 00000100:00100000:3.0:1789048469.553595:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789048469.553604:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:9891:x1875953111314688:12345-0@lo:502: 00000100:00100000:3.0:1789048469.553915:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:9891:x1875953111314688:12345-0@lo:502: Request processed in 310us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048469.553922:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789048469.553970:0:9891:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2ae92240 going to sleep for 11 seconds 00000100:00100000:3.0:1789048469.553991:0:9891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9891:1875953111314688:0@lo:502: 00000020:01000000:3.0:1789048469.554016:0:9891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048469.554021:0:9891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048469.554023:0:9891:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789048469.554027:0:9891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:3.0:1789048469.554075:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1789048469.554098:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789048469.554106:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c08775d3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d44 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048469.554117:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c08775d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d44 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048469.554127:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789048469.554129:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959c335d0800 from 39 10000000:01000000:3.0:1789048469.554132:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789048469.554156:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c08775d60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048469.554164:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c08775d60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048469.554179:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c08775d60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048469.554191:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111314816:0@lo:101: 00000100:00100000:3.0:1789048469.554218:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048469.554241:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c08ae3240 going to sleep for 11 seconds 00000100:00100000:0.0:1789048469.554525:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111315328:0@lo:400: 00000100:00100000:0.0:1789048469.554555:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.554577:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111315840:0@lo:400: 00000100:00100000:0.0:1789048469.554598:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.554631:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789048469.554637:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111314944:0@lo:400: 00000100:00100000:0.0:1789048469.554662:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.554681:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111315456:0@lo:400: 00000100:00100000:0.0:1789048469.554700:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.554717:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111315968:0@lo:400: 00000100:00100000:0.0:1789048469.554736:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.554962:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06970a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111315072:0@lo:400: 00000100:00100000:0.0:1789048469.554988:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.555006:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111315584:0@lo:400: 00000100:00100000:0.0:1789048469.555036:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.555057:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111316096:0@lo:400: 00000100:00100000:0.0:1789048469.555079:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.555091:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789048469.555096:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111315200:0@lo:400: 00000100:00100000:0.0:1789048469.555114:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.555134:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111315712:0@lo:400: 00000100:00100000:0.0:1789048469.555157:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.555188:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111315328 00000100:00100000:0.0:1789048469.555194:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111315328 00000100:00100000:0.0:1789048469.555227:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111315072 00000100:00100000:0.0:1789048469.555230:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111315072 00000100:00100000:0.0:1789048469.555244:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789048469.555252:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111315328:12345-0@lo:400: 00000100:00100000:0.0:1789048469.555293:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111315328:12345-0@lo:400: Request processed in 42us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.555300:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789048469.555314:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789048469.555320:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111315072:12345-0@lo:400: 00000100:00100000:0.0:1789048469.555378:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111315072:12345-0@lo:400: Request processed in 58us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.555384:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789048469.555400:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111315840 00000100:00100000:0.0:1789048469.555403:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111315840 00000100:00100000:0.0:1789048469.555444:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111315712 00000100:00100000:0.0:1789048469.555447:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111315712 00000100:00100000:0.0:1789048469.556612:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789048469.556627:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d312d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111315840:12345-0@lo:400: 00000100:00100000:0.0:1789048469.556683:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d312d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111315840:12345-0@lo:400: Request processed in 62us (2083us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.556689:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789048469.556706:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789048469.556712:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111315712:12345-0@lo:400: 00000100:00100000:0.0:1789048469.556741:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111315712:12345-0@lo:400: Request processed in 29us (1584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.556757:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789048469.556783:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111314944 00000100:00100000:0.0:1789048469.556788:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111314944 00000100:00100000:0.0:1789048469.556812:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111315456 00000100:00100000:0.0:1789048469.556815:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111315456 00000100:00100000:0.0:1789048469.556828:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111315968 00000100:00100000:0.0:1789048469.556831:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111315968 00000100:00100000:0.0:1789048469.556841:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111315584 00000100:00100000:0.0:1789048469.556843:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111315584 00000100:00100000:0.0:1789048469.556856:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111316096 00000100:00100000:0.0:1789048469.556859:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111316096 00000100:00100000:0.0:1789048469.556871:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111315200 00000100:00100000:0.0:1789048469.556874:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111315200 00000100:00100000:0.0:1789048469.556886:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789048469.556892:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111314944:12345-0@lo:400: 00000100:00100000:0.0:1789048469.556922:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111314944:12345-0@lo:400: Request processed in 30us (2260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.556927:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789048469.556938:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789048469.556944:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111315456:12345-0@lo:400: 00000100:00100000:0.0:1789048469.556968:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111315456:12345-0@lo:400: Request processed in 24us (2267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.556973:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789048469.556983:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789048469.556988:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111315968:12345-0@lo:400: 00000100:00100000:0.0:1789048469.557013:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111315968:12345-0@lo:400: Request processed in 25us (2275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.557018:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789048469.557036:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789048469.557041:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111315584:12345-0@lo:400: 00000100:00100000:0.0:1789048469.557070:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111315584:12345-0@lo:400: Request processed in 29us (2034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.557076:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789048469.557087:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789048469.557093:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111316096:12345-0@lo:400: 00000100:00100000:0.0:1789048469.557119:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111316096:12345-0@lo:400: Request processed in 27us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.557124:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789048469.557135:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789048469.557142:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111315200:12345-0@lo:400: 00000100:00100000:0.0:1789048469.557166:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111315200:12345-0@lo:400: Request processed in 26us (2051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.557171:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1789048469.557209:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789048469.557214:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789048469.557216:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789048469.557265:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b06972680 x1875953111315200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048469.557279:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111315200:0@lo:400: 00010000:00080000:0.0:1789048469.557291:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b06971880 x1875953111315712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048469.557299:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111315712:0@lo:400: 00000100:00100000:0.0:1789048469.557310:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06970a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111315072:0@lo:400: 00010000:00080000:0.0:1789048469.557357:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b06971c00 x1875953111315584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048469.557366:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111315584:0@lo:400: 00010000:00080000:0.0:1789048469.557377:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c20221880 x1875953111316096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048469.557385:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111316096:0@lo:400: 00010000:00080000:0.0:1789048469.557431:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b06972a00 x1875953111314944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048469.557441:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111314944:0@lo:400: 00010000:00080000:0.0:1789048469.557452:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b06970380 x1875953111315456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048469.557458:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111315456:0@lo:400: 00000100:00100000:2.0:1789048469.559645:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111314560:0@lo:8: 00000100:00100000:2.0:1789048469.559722:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048469.560480:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111314816 00000100:00100000:1.0:1789048469.560490:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111314816 00000100:00100000:1.0:1789048469.560550:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789048469.560559:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:6494:x1875953111314816:12345-0@lo:101: 00010000:00010000:1.0:1789048469.560574:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048469.560591:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c013d7a00/0x133f221c08775d67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775d60 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048469.560619:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c013d7a00/0x133f221c08775d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775d60 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048469.560631:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c013d7a00/0x133f221c08775d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775d60 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048469.560639:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c013d7a00, rc 0) 00000100:00100000:1.0:1789048469.560695:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111314816:12345-0@lo:101: Request processed in 138us (6476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048469.560702:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789048469.560751:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111314816:0@lo:101: 00010000:00010000:1.0:1789048469.560768:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c08775d60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d67 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048469.560777:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c08775d60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775d67 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048469.560846:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111316224:0@lo:501: 00000100:00100000:1.0:1789048469.560891:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048469.560908:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c05346d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789048469.560920:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111316224 00000100:00100000:1.0:1789048469.560923:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111316224 00000100:00100000:1.0:1789048469.560939:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789048469.560945:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111316224:12345-0@lo:501: 00000100:00100000:1.0:1789048469.561047:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111316224:12345-0@lo:501: Request processed in 99us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048469.561053:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789048469.561081:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111316224:0@lo:501: 00000100:00100000:1.0:1789048469.561104:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111316352:0@lo:503: 00000100:00100000:1.0:1789048469.561143:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048469.561155:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c05346d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789048469.561165:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111316352 00000100:00100000:1.0:1789048469.561169:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111316352 00000100:00100000:1.0:1789048469.561185:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789048469.561190:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111316352:12345-0@lo:503: 00000100:00100000:1.0:1789048469.561260:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111316352:12345-0@lo:503: Request processed in 69us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048469.561266:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789048469.561300:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111316352:0@lo:503: 00000100:00100000:3.0:1789048469.564637:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111314560 00000100:00100000:3.0:1789048469.564653:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111314560 00000100:00100000:3.0:1789048469.564697:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789048469.564706:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3619:x1875953111314560:12345-0@lo:8: 00010000:00080000:3.0:1789048469.564740:0:8414:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:3.0:1789048469.564770:0:8414:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x133f221c08775d6e 00002000:00100000:3.0:1789048469.564785:0:8414:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff959c3fb27000 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789048469.564789:0:8414:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1789048469.564793:0:8414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789048469.564856:0:8414:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:0.0:1789048469.566820:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b06971f80 x1875953111315968/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048469.566847:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111315968:0@lo:400: 00000100:00100000:0.0:1789048469.566913:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111315328:0@lo:400: 00010000:00080000:0.0:1789048469.566927:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b06973800 x1875953111315840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048469.566935:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111315840:0@lo:400: 00002000:00080000:3.0:1789048469.567191:0:8414:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789048469.567222:0:8414:0:(import.c:65:import_set_state_nolock()) ffff959c3fb26800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789048469.567310:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1875953111314560:12345-0@lo:8: Request processed in 2603us (7587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048469.567319:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789048469.571799:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0747f800 x1875953111314560/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789048479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048469.571815:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789048469.571841:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789048469.571850:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:2.0:1789048469.571857:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789048469.571860:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3fb24000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789048469.571887:0:3619:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789048469.571894:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111314560:0@lo:8: 00000004:00080000:0.0:1789048469.573610:0:9892:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789048469.573704:0:9892:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 224327370174ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789048469.573714:0:9892:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789048469.574585:0:9894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875953111316480:0@lo:700: 00000100:00100000:3.0:1789048469.574661:0:9894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048469.574703:0:9894:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c08ae3900 going to sleep for 11 seconds 00000100:00100000:0.0:1789048469.575778:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111316480 00000100:00100000:0.0:1789048469.575789:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111316480 00000100:00100000:0.0:1789048469.575857:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789048469.575868:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9894:x1875953111316480:12345-0@lo:700: 00000100:00100000:0.0:1789048469.575933:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b13480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8421:1875953111316608:0@lo:700: 00000100:00100000:2.0:1789048469.581901:0:9895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9895:1875953111316736:0@lo:502: 00000100:00100000:2.0:1789048469.581970:0:9895:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048469.582007:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111316736 00000100:00100000:2.0:1789048469.582012:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111316736 00000100:00100000:2.0:1789048469.582060:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789048469.582069:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:9895:x1875953111316736:12345-0@lo:502: 00000100:00100000:2.0:1789048469.582173:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:9895:x1875953111316736:12345-0@lo:502: Request processed in 105us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048469.582181:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789048469.582230:0:9895:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b069803c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048469.582250:0:9895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9895:1875953111316736:0@lo:502: 00000100:00100000:2.0:1789048469.582290:0:9895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9895:1875953111316864:0@lo:502: 00000100:00100000:2.0:1789048469.582319:0:9895:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048469.582356:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111316864 00000100:00100000:2.0:1789048469.582360:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111316864 00000100:00100000:2.0:1789048469.582383:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789048469.582388:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:9895:x1875953111316864:12345-0@lo:502: 00000100:00080000:3.0:1789048469.582843:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789048469.588554:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.588591:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c39495cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048469.588627:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111316608 00000100:00100000:0.0:1789048469.588635:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111316608 00000100:00100000:0.0:1789048469.588682:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789048469.588691:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8421:x1875953111316608:12345-0@lo:700: 00000100:00100000:2.0:1789048469.600201:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:9895:x1875953111316864:12345-0@lo:502: Request processed in 17803us (17872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048469.600217:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789048469.600370:0:9895:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b069803c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048469.600396:0:9895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9895:1875953111316864:0@lo:502: 00000040:00080000:2.0:1789048469.600445:0:9895:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1789048469.600663:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1789048469.600702:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789048469.600713:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c08775d60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d67 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.600724:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c08775d60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d67 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048469.600734:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789048469.600737:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c335d0800 from 6 10000000:01000000:0.0:1789048469.600740:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789048469.600772:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00030800/0x133f221c08775d75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.600779:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c00030800/0x133f221c08775d75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.600788:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c00030800/0x133f221c08775d75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048469.600813:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111316992:0@lo:101: 00000100:00100000:0.0:1789048469.600854:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.600881:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41501840 going to sleep for 11 seconds 00000100:00100000:2.0:1789048469.600916:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111316992 00000100:00100000:2.0:1789048469.600923:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111316992 00000100:00100000:2.0:1789048469.600966:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789048469.600973:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111316992:12345-0@lo:101: 00010000:00010000:2.0:1789048469.600986:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048469.601007:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c02836000/0x133f221c08775d7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775d75 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048469.601029:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c02836000/0x133f221c08775d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775d75 expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048469.601039:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c02836000/0x133f221c08775d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775d75 expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048469.601048:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02836000, rc 0) 00000100:00100000:2.0:1789048469.601076:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111316992:12345-0@lo:101: Request processed in 103us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048469.601082:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000004:00080000:2.0:1789048469.601191:0:7428:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789048469.608572:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111316992:0@lo:101: 00010000:00010000:0.0:1789048469.608602:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c00030800/0x133f221c08775d75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d7c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.608616:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c00030800/0x133f221c08775d75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775d7c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048469.608683:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111317120:0@lo:256: 00000100:00100000:0.0:1789048469.608749:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.608789:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41501840 going to sleep for 11 seconds 00000100:00100000:2.0:1789048469.608813:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111317120 40000000:02000000:0.0:1789048469.608814:0:6504:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1789048469.608822:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111317120 00000100:00100000:2.0:1789048469.608869:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789048469.608878:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111317120:12345-0@lo:256: 20000000:01000000:2.0:1789048469.608898:0:6490:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789048469.608914:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789048469.608917:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789048469.609009:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111317120:12345-0@lo:256: Request processed in 132us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048469.609017:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789048469.612179:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8421:x1875953111316608:12345-0@lo:700: Request processed in 23483us (23621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.612193:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789048469.612252:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111317120:0@lo:256: 10000000:01000000:0.0:1789048469.612310:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789048469.612319:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00030800/0x133f221c08775d75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d7c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.612360:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c00030800/0x133f221c08775d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d7c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048469.612370:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789048469.612381:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1789048469.612384:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789048469.612430:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775d83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.612438:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775d83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.612447:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775d83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048469.612463:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111317248:0@lo:101: 00000100:00100000:0.0:1789048469.612497:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.612529:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41501840 going to sleep for 11 seconds 00000100:00100000:0.0:1789048469.612546:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111317248 00000100:00100000:0.0:1789048469.612552:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111317248 00000100:00100000:0.0:1789048469.612583:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789048469.612590:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111317248:12345-0@lo:101: 00010000:00010000:0.0:1789048469.612603:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048469.612614:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c00031a00/0x133f221c08775d8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775d83 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.612636:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c00031a00/0x133f221c08775d8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775d83 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.612646:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c00031a00/0x133f221c08775d8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775d83 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.612653:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c00031a00, rc 0) 00000100:00100000:0.0:1789048469.612676:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111317248:12345-0@lo:101: Request processed in 86us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.612689:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789048469.612720:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111317248:0@lo:101: 00010000:00010000:0.0:1789048469.612730:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775d83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d8a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.612739:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775d83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775d8a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048469.612783:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111317376:0@lo:501: 00000100:00100000:0.0:1789048469.612805:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.612817:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41501840 going to sleep for 11 seconds 00010000:00080000:0.0:1789048469.612840:0:8421:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07b13480 x1875953111316608/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789048485 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048469.612851:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b13480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8421:1875953111316608:0@lo:700: 40000000:02000000:0.0:1789048469.612859:0:8421:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:2.0:1789048469.616453:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111317376 00000100:00100000:2.0:1789048469.616467:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111317376 00000100:00100000:2.0:1789048469.616531:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789048469.616541:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111317376:12345-0@lo:501: 00000100:00100000:2.0:1789048469.616714:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111317376:12345-0@lo:501: Request processed in 174us (3907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048469.616721:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789048469.633787:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111317376:0@lo:501: 00000100:00100000:0.0:1789048469.633840:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111317504:0@lo:503: 00000100:00100000:0.0:1789048469.633914:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.633951:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41501840 going to sleep for 11 seconds 00000100:00100000:0.0:1789048469.633972:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111317504 00000100:00100000:0.0:1789048469.633979:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111317504 00000100:00100000:0.0:1789048469.634043:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789048469.634052:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111317504:12345-0@lo:503: 00000100:00100000:0.0:1789048469.634611:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111317504:12345-0@lo:503: Request processed in 558us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.634629:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789048469.634701:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111317504:0@lo:503: 00000001:00100000:0.0:1789048469.637119:0:9492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789048469.640520:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9894:x1875953111316480:12345-0@lo:700: Request processed in 64646us (65850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048469.640538:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789048469.640806:0:9894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0747f800 x1875953111316480/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789048485 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048469.640822:0:9894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875953111316480:0@lo:700: 00000100:00100000:0.0:1789048469.656432:0:9900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9900:1875953111317632:0@lo:502: 00000100:00100000:0.0:1789048469.656520:0:9900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.656564:0:9900:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41501840 going to sleep for 11 seconds 00000100:00100000:1.0:1789048469.656650:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111317632 00000100:00100000:1.0:1789048469.656660:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111317632 00000100:00100000:1.0:1789048469.656717:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789048469.656726:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:9900:x1875953111317632:12345-0@lo:502: 00000100:00100000:1.0:1789048469.656857:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:9900:x1875953111317632:12345-0@lo:502: Request processed in 132us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048469.656865:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789048469.656966:0:9900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9900:1875953111317632:0@lo:502: 00000020:01000000:0.0:1789048469.656994:0:9900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789048469.657002:0:9900:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789048469.657009:0:9900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048469.657011:0:9900:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789048469.657015:0:9900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789048469.657019:0:9900:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:0.0:1789048469.657039:0:9900:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789048469.657042:0:9900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789048469.657057:0:9900:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff959c3e883380) 00000020:00000080:0.0:1789048469.657081:0:9900:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1789048469.657086:0:9900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789048469.657167:0:9900:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789048469.657173:0:9900:0:(osd_handler.c:8921:osd_obd_connect()) connect #7 00000020:00000080:0.0:1789048469.657179:0:9900:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c08775d98 00010000:00080000:0.0:1789048469.657204:0:9900:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959b0802b800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:0.0:1789048469.657476:0:9900:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1789048469.657602:0:9900:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789048469.657613:0:9900:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789048469.657775:0:9900:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789048469.657889:0:9900:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789048469.658015:0:9900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789048469.658109:0:9900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789048469.662442:0:9902:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789048469.662458:0:9902:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789048469.664138:0:9900:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789048469.664152:0:9900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789048469.664193:0:9900:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789048469.664221:0:9900:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x133f221c08775d9f 00000100:00080000:1.0:1789048469.664232:0:9900:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789048469.664244:0:9900:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff959b0802b800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048469.664284:0:9900:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b07bf2a00 x1875953111317760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789048469.664312:0:9900:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789048469.664391:0:9900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048469.664396:0:9900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048469.664398:0:9900:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789048469.664401:0:9900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048469.664404:0:9900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048469.664406:0:9900:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789048469.664408:0:9900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789048469.664410:0:9900:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789048469.664447:0:9900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9900:1875953111317888:0@lo:502: 00000100:00100000:1.0:1789048469.664527:0:9900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048469.664638:0:9900:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18cef840 going to sleep for 11 seconds 00000100:00100000:1.0:1789048469.664676:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111317888 00000100:00100000:1.0:1789048469.664683:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111317888 00000100:00100000:1.0:1789048469.664731:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789048469.664741:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:9900:x1875953111317888:12345-0@lo:502: 00000100:00100000:1.0:1789048469.664864:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:9900:x1875953111317888:12345-0@lo:502: Request processed in 124us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048469.664871:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789048469.664936:0:9900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:9900:1875953111317888:0@lo:502: 00000020:01000000:1.0:1789048469.664962:0:9900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048469.664967:0:9900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048469.664968:0:9900:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789048469.664972:0:9900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:3.0:1789048469.665135:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111317760:0@lo:8: 00000100:00100000:3.0:1789048469.665180:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1789048469.668087:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1789048469.668122:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789048469.668134:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775d83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d8a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.668147:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775d83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d8a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048469.668157:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789048469.668160:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff959c394bb380 from 1 10000000:01000000:0.0:1789048469.668163:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789048469.668226:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775da6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.668234:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775da6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.668246:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775da6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048469.668267:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111318016:0@lo:101: 00000100:00100000:0.0:1789048469.668326:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.668374:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111318016 00000100:00100000:0.0:1789048469.668381:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111318016 00000100:00100000:0.0:1789048469.668428:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789048469.668450:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111318016:12345-0@lo:101: 00010000:00010000:0.0:1789048469.668463:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048469.668474:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c420cd000/0x133f221c08775dad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775da6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.668495:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c420cd000/0x133f221c08775dad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775da6 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.668505:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c420cd000/0x133f221c08775dad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775da6 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.668513:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c420cd000, rc 0) 00000100:00100000:0.0:1789048469.668539:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:6494:x1875953111318016:12345-0@lo:101: Request processed in 91us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.668545:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789048469.668571:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c415019c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048469.668587:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111318016:0@lo:101: 00010000:00010000:0.0:1789048469.668599:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775da6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775dad expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.668608:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775da6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775dad expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048469.668663:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111318144:0@lo:501: 00000100:00100000:0.0:1789048469.668682:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.668699:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111318144 00000100:00100000:0.0:1789048469.668702:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111318144 00000100:00100000:0.0:1789048469.668720:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789048469.668725:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:6494:x1875953111318144:12345-0@lo:501: 00000100:00100000:0.0:1789048469.668789:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:6494:x1875953111318144:12345-0@lo:501: Request processed in 63us (105us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789048469.668795:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789048469.668814:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c415019c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048469.668822:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111318144:0@lo:501: 10000000:01000000:0.0:1789048469.668840:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789048469.668845:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775da6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775dad expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048469.668852:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775da6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775dad expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048469.669180:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111317760 00000100:00100000:1.0:1789048469.669184:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111317760 00000100:00100000:1.0:1789048469.669211:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789048469.669216:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3619:x1875953111317760:12345-0@lo:8: 00010000:00080000:1.0:1789048469.669239:0:8412:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:1.0:1789048469.669263:0:8412:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x133f221c08775db4 00002000:00100000:1.0:1789048469.669274:0:8412:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff959c416db800 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789048469.669278:0:8412:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789048469.669281:0:8412:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789048469.669367:0:8412:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789048469.669389:0:8412:0:(import.c:65:import_set_state_nolock()) ffff959c416de000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789048469.669441:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1875953111317760:12345-0@lo:8: Request processed in 224us (4261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048469.669448:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789048469.669483:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07bf2a00 x1875953111317760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789048479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048469.669493:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789048469.669500:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789048469.669513:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:1.0:1789048469.669518:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789048469.669520:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b0802b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789048469.669530:0:3619:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789048469.669534:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111317760:0@lo:8: 00000004:00080000:3.0:1789048469.669896:0:9902:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789048469.672184:0:9894:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789048469.672214:0:9894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875953111318400:0@lo:7: 00000100:00100000:1.0:1789048469.672280:0:9894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048469.672316:0:9894:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048469.672521:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111318272:0@lo:13: 00000100:00100000:1.0:1789048469.672550:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048469.672588:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111318400 00000100:00100000:1.0:1789048469.672595:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111318400 00000100:00100000:1.0:1789048469.672638:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789048469.672647:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9894:x1875953111318400:12345-0@lo:7: 00000004:00080000:2.0:1789048469.678388:0:9902:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 224432051169ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789048469.678398:0:9902:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789048469.681527:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111318272 00000100:00100000:2.0:1789048469.681553:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111318272 00000100:00100000:2.0:1789048469.681614:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789048469.681624:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1875953111318272:12345-0@lo:13: 00002000:00000024:2.0:1789048469.681653:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923857408 avail 3692335104 00000100:00100000:2.0:1789048469.681737:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1875953111318272:12345-0@lo:13: Request processed in 116us (9186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048469.681744:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789048469.681790:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07bf2a00 x1875953111318272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048469.681809:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111318272:0@lo:13: 00002000:00080000:1.0:1789048469.684504:0:8413:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789048469.684515:0:8413:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789048469.684723:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9894:x1875953111318400:12345-0@lo:7: Request processed in 12072us (12439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048469.684734:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789048469.688804:0:9894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07bf2680 x1875953111318400/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789048485 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048469.688825:0:9894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875953111318400:0@lo:7: 00000004:00080000:0.0:1789048469.688841:0:9894:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789048469.688883:0:9894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875953111318528:0@lo:5: 00000100:00100000:0.0:1789048469.688940:0:9894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.688968:0:9894:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c415019c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048469.689412:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111318528 00000100:00100000:1.0:1789048469.689429:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111318528 00000100:00100000:1.0:1789048469.689485:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789048469.689495:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9894:x1875953111318528:12345-0@lo:5: 00002000:00080000:1.0:1789048469.689520:0:8412:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1789048469.689570:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9894:x1875953111318528:12345-0@lo:5: Request processed in 76us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048469.689591:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789048469.689730:0:9894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07b13100 x1875953111318528/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789048485 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048469.689741:0:9894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875953111318528:0@lo:5: 00000004:00080000:2.0:1789048469.689751:0:9894:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789048469.689786:0:9894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875953111318656:0@lo:5: 00000100:00100000:2.0:1789048469.689814:0:9894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048469.689832:0:9894:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3e87e300 going to sleep for 11 seconds 00000100:00100000:2.0:1789048469.689845:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111318656 00000100:00100000:2.0:1789048469.689849:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111318656 00000100:00100000:2.0:1789048469.689898:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789048469.689905:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9894:x1875953111318656:12345-0@lo:5: 00002000:00080000:2.0:1789048469.689933:0:8414:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000004:00080000:1.0:1789048469.693706:0:9903:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789048469.693714:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789048469.693735:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111318784:0@lo:13: 00000100:00100000:1.0:1789048469.693735:0:9903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9903:1875953111318912:0@lo:7: 00000004:00080000:0.0:1789048469.696033:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789048469.700466:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048469.702297:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111318784 00000100:00100000:3.0:1789048469.702312:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111318784 00000100:00100000:3.0:1789048469.702396:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789048469.702406:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111318784:12345-0@lo:13: 00002000:00000024:3.0:1789048469.702445:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:3.0:1789048469.702519:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111318784:12345-0@lo:13: Request processed in 114us (2061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048469.702526:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789048469.702559:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789048469.702596:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07bf0e00 x1875953111318784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048469.702617:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111318784:0@lo:13: 00000100:00100000:1.0:1789048469.706302:0:9903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048469.706401:0:9903:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048469.708740:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111318912 00000100:00100000:3.0:1789048469.708755:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111318912 00000100:00100000:3.0:1789048469.708813:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789048469.708824:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9903:x1875953111318912:12345-0@lo:7: 00002000:00080000:3.0:1789048469.713956:0:8412:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789048469.713968:0:8412:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789048469.720954:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9903:x1875953111318912:12345-0@lo:7: Request processed in 12124us (14650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048469.720969:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789048469.721710:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9894:x1875953111318656:12345-0@lo:5: Request processed in 31803us (31892us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789048469.721720:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789048469.723440:0:9894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c03e54a80 x1875953111318656/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789048485 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048469.723460:0:9894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875953111318656:0@lo:5: 00000004:00080000:3.0:1789048469.723476:0:9894:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789048469.723524:0:9894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9894:1875953111319040:0@lo:900: 00000100:00100000:3.0:1789048469.723597:0:9894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048469.723646:0:9894:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2ae92c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789048469.723667:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111319040 00000100:00100000:3.0:1789048469.723674:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111319040 00000100:00100000:3.0:1789048469.723725:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789048469.723735:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9894:x1875953111319040:12345-0@lo:900: 00000100:00100000:3.0:1789048469.723796:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9894:x1875953111319040:12345-0@lo:900: Request processed in 63us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048469.723804:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789048469.723980:0:9894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d89880 x1875953111319040/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789048485 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048469.724060:0:9894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9894:1875953111319040:0@lo:900: 00010000:00080000:0.0:1789048469.726700:0:9903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07bf1880 x1875953111318912/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789048485 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048469.726719:0:9903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9903:1875953111318912:0@lo:7: 00000004:00080000:0.0:1789048469.726735:0:9903:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789048469.726792:0:9903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b10a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9903:1875953111319168:0@lo:5: 00000100:00100000:0.0:1789048469.726860:0:9903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.726900:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111319168 00000100:00100000:0.0:1789048469.726906:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111319168 00000100:00100000:0.0:1789048469.726954:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789048469.726963:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9903:x1875953111319168:12345-0@lo:5: 00002000:00080000:0.0:1789048469.726990:0:8804:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789048469.726993:0:8804:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789048469.730111:0:9903:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c415019c0 going to sleep for 11 seconds 00000001:00080000:0.0:1789048469.739987:0:9492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:0.0:1789048469.740034:0:9492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1789048469.740045:0:9492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789048469.740403:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9903:x1875953111319168:12345-0@lo:5: Request processed in 13435us (13539us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789048469.740427:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789048469.740964:0:9903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07b10a80 x1875953111319168/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789048485 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048469.740979:0:9903:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789048469.740988:0:9903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b10a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9903:1875953111319168:0@lo:5: 00000004:00080000:0.0:1789048469.741052:0:9903:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789048469.741118:0:9903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b10a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9903:1875953111319296:0@lo:700: 00000100:00100000:0.0:1789048469.741162:0:9903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.741253:0:9903:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c415019c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048469.746101:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111319296 00000100:00100000:1.0:1789048469.746123:0:8420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111319296 00000100:00100000:1.0:1789048469.746211:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789048469.746223:0:8420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9903:x1875953111319296:12345-0@lo:700: 00000100:00100000:0.0:1789048469.769560:0:8420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9903:x1875953111319296:12345-0@lo:700: Request processed in 23327us (28386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048469.769579:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789048469.769817:0:9903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07b10a80 x1875953111319296/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789048485 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048469.769836:0:9903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b10a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9903:1875953111319296:0@lo:700: 00000004:02000040:2.0:1789048469.771205:0:9903:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1789048469.777971:0:9903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b10380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9903:1875953111319424:0@lo:5: 00000100:00100000:0.0:1789048469.778064:0:9903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048469.778177:0:9903:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c415019c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048469.786611:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111319424 00000100:00100000:3.0:1789048469.786811:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111319424 00000100:00100000:3.0:1789048469.786908:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789048469.786922:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9903:x1875953111319424:12345-0@lo:5: 00000020:00000004:1.0:1789048469.799414:0:9916:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789048469.800924:0:9916:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00002000:00080000:3.0:1789048469.814215:0:8412:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1789048469.814242:0:8412:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1789048469.815884:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9903:x1875953111319424:12345-0@lo:5: Request processed in 28957us (37812us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789048469.815899:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789048469.815980:0:9903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07b10380 x1875953111319424/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789048485 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048469.816010:0:9903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b10380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9903:1875953111319424:0@lo:5: 00000004:00080000:3.0:1789048469.816029:0:9903:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000100:00100000:1.0:1789048470.493702:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789048470.493746:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111319552:0@lo:41: 00000100:00100000:1.0:1789048470.493832:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048470.493912:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111319552 00000100:00100000:1.0:1789048470.493921:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111319552 00000100:00100000:1.0:1789048470.493977:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789048470.493986:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111319552:12345-0@lo:41: 00000004:00000024:1.0:1789048470.494029:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789048470.494077:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111319552:12345-0@lo:41: Request processed in 92us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048470.494092:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789048470.494144:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111319552:0@lo:41: 00010000:00010000:1.0:1789048470.497902:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789048470.980020:0:9492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1789048471.005856:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111319680:0@lo:13: 00000100:00100000:1.0:1789048471.005969:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048471.006479:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789048471.006491:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111319808:0@lo:13: 00000100:00100000:1.0:1789048471.006602:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048471.011152:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111319680 00000100:00100000:3.0:1789048471.011175:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111319680 00000100:00100000:3.0:1789048471.011255:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111319808 00000100:00100000:3.0:1789048471.011259:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111319808 00000100:00100000:3.0:1789048471.011289:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789048471.011301:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111319680:12345-0@lo:13: 00000100:00080000:1.0:1789048471.011324:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789048471.011365:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048471.011493:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111319680:12345-0@lo:13: Request processed in 194us (5525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048471.011502:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789048471.011522:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789048471.012221:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111319808:12345-0@lo:13: 00002000:00000024:3.0:1789048471.012241:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048471.012285:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111319808:12345-0@lo:13: Request processed in 756us (5684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048471.012293:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789048471.012592:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07b11500 x1875953111319808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048471.012620:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111319808:0@lo:13: 00010000:00080000:1.0:1789048471.012637:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d89880 x1875953111319680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048471.012650:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111319680:0@lo:13: 00010000:00010000:1.0:1789048471.518396:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048472.051693:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789048472.051727:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111319936:0@lo:41: 00000100:00100000:2.0:1789048472.051835:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048472.051922:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111319936 00000100:00100000:2.0:1789048472.051932:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111319936 00000100:00100000:2.0:1789048472.051994:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789048472.052004:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111319936:12345-0@lo:41: 00000004:00000024:2.0:1789048472.052049:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789048472.052106:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111319936:12345-0@lo:41: Request processed in 102us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048472.052114:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789048472.052721:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111319936:0@lo:41: 00010000:00010000:3.0:1789048472.549364:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789048473.370555:0:10018:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789048473.377272:0:10018:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789048473.566138:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789048474.460318:0:10066:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789048474.460329:0:10066:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1789048474.589923:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048475.101802:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789048475.101850:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111320192:0@lo:400: 00000100:00100000:2.0:1789048475.101926:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048475.102006:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789048475.102019:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111320064:0@lo:400: 00000100:00100000:3.0:1789048475.102130:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111320320:0@lo:400: 00000100:00100000:1.0:1789048475.102176:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111320576:0@lo:400: 00000100:00100000:3.0:1789048475.102200:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048475.102386:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111320192 00000100:00100000:0.0:1789048475.102405:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111320192 00000100:00100000:0.0:1789048475.102821:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789048475.102834:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111320192:12345-0@lo:400: 00000100:00100000:3.0:1789048475.102914:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111320832:0@lo:400: 00000100:00100000:1.0:1789048475.104281:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048475.104380:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111321088:0@lo:400: 00000100:00100000:1.0:1789048475.104431:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048475.104474:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111321600:0@lo:400: 00000100:00100000:1.0:1789048475.104497:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048475.104528:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789048475.104535:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111320448:0@lo:400: 00000100:00100000:1.0:1789048475.104556:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048475.104574:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111320960:0@lo:400: 00000100:00100000:1.0:1789048475.104592:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048475.104609:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111321472:0@lo:400: 00000100:00100000:1.0:1789048475.104626:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048475.107756:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048475.107857:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111321088 00000100:00100000:2.0:1789048475.107866:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111321088 00000100:00100000:2.0:1789048475.107929:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111321600 00000100:00100000:2.0:1789048475.107933:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111321600 00000100:00100000:2.0:1789048475.107945:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111320960 00000100:00100000:2.0:1789048475.107948:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111320960 00000100:00100000:2.0:1789048475.107960:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111321472 00000100:00100000:2.0:1789048475.107963:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111321472 00000100:00100000:2.0:1789048475.107979:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789048475.107987:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111321088:12345-0@lo:400: 00000100:00080000:1.0:1789048475.108672:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789048475.108679:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789048475.108701:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111320704:0@lo:400: 00000100:00100000:1.0:1789048475.108759:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048475.108795:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111321216:0@lo:400: 00000100:00100000:1.0:1789048475.108816:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048475.108828:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111321728:0@lo:13: 00000100:00100000:1.0:1789048475.108876:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048475.108910:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789048475.108917:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111321856:0@lo:13: 00000100:00100000:1.0:1789048475.108939:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048475.108968:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111320320 00000100:00100000:1.0:1789048475.108974:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111320320 00000100:00100000:1.0:1789048475.109007:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111320576 00000100:00100000:1.0:1789048475.109010:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111320576 00000100:00100000:1.0:1789048475.109024:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789048475.109031:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111320320:12345-0@lo:400: 00000100:00100000:1.0:1789048475.111925:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111320320:12345-0@lo:400: Request processed in 2885us (9717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048475.111958:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789048475.111995:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789048475.112008:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111320576:12345-0@lo:400: 00000100:00100000:3.0:1789048475.112781:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111321728 00000100:00100000:3.0:1789048475.112800:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111321728 00000100:00100000:3.0:1789048475.112942:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111321856 00000100:00100000:3.0:1789048475.113015:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111321856 00000100:00100000:3.0:1789048475.113040:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789048475.113049:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875953111321728:12345-0@lo:13: 00002000:00000024:3.0:1789048475.113086:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048475.113205:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111320064 00000100:00100000:0.0:1789048475.113211:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111320064 00000100:00100000:0.0:1789048475.113252:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789048475.113259:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111320064:12345-0@lo:400: 00000100:00100000:2.0:1789048475.114309:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111321088:12345-0@lo:400: Request processed in 6315us (9867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048475.114324:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789048475.114384:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789048475.114399:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111321600:12345-0@lo:400: 00000100:00100000:2.0:1789048475.114462:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111321600:12345-0@lo:400: Request processed in 72us (9964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048475.114468:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789048475.114480:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789048475.114487:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111320960:12345-0@lo:400: 00000100:00100000:2.0:1789048475.114520:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111320960:12345-0@lo:400: Request processed in 34us (9927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048475.114525:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789048475.114552:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789048475.114559:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3621:x1875953111321472:12345-0@lo:400: 00000100:00100000:2.0:1789048475.114589:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3621:x1875953111321472:12345-0@lo:400: Request processed in 32us (9962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048475.114594:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789048475.114622:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111320448 00000100:00100000:2.0:1789048475.114629:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111320448 00000100:00100000:2.0:1789048475.114658:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111320704 00000100:00100000:2.0:1789048475.114661:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111320704 00000100:00100000:2.0:1789048475.114689:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111321216 00000100:00100000:2.0:1789048475.114692:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111321216 00000100:00100000:2.0:1789048475.114707:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789048475.114713:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111320448:12345-0@lo:400: 00000100:00100000:2.0:1789048475.114744:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111320448:12345-0@lo:400: Request processed in 32us (10187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048475.114749:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789048475.114760:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789048475.114765:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111320704:12345-0@lo:400: 00000100:00100000:2.0:1789048475.114797:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111320704:12345-0@lo:400: Request processed in 33us (6038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048475.114803:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789048475.114815:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789048475.114821:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111321216:12345-0@lo:400: 00000100:00100000:2.0:1789048475.114850:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111321216:12345-0@lo:400: Request processed in 30us (6033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048475.114856:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1789048475.114869:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789048475.114911:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb4f100 x1875953111320704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048475.114926:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111320704:0@lo:400: 00010000:00080000:2.0:1789048475.114942:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb4c380 x1875953111321216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048475.114950:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111321216:0@lo:400: 00010000:00080000:2.0:1789048475.114988:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb4f480 x1875953111320448/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048475.114997:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111320448:0@lo:400: 00010000:00080000:2.0:1789048475.115007:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb4e680 x1875953111320960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048475.115014:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111320960:0@lo:400: 00010000:00080000:2.0:1789048475.115025:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb4d500 x1875953111321472/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048475.115031:0:3621:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789048475.115040:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111321472:0@lo:400: 00010000:00080000:2.0:1789048475.115053:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb4e300 x1875953111321088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048475.115079:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111321088:0@lo:400: 00010000:00080000:2.0:1789048475.115091:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb4d180 x1875953111321600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048475.115097:0:3621:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1789048475.115106:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111321600:0@lo:400: 00000100:00100000:2.0:1789048475.115393:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048475.115422:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111320832 00000100:00100000:2.0:1789048475.115427:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111320832 00000100:00100000:2.0:1789048475.115455:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789048475.115461:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111320832:12345-0@lo:400: 00000100:00100000:2.0:1789048475.115490:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111320832:12345-0@lo:400: Request processed in 30us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048475.115495:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1789048475.115508:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789048475.115527:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb4ca80 x1875953111320832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048475.115536:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111320832:0@lo:400: 00000100:00100000:2.0:1789048475.115545:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111321344:0@lo:400: 00000100:00100000:2.0:1789048475.115592:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048475.115611:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111321344 00000100:00100000:2.0:1789048475.115615:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111321344 00000100:00100000:2.0:1789048475.115639:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789048475.115644:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111321344:12345-0@lo:400: 00000100:00100000:2.0:1789048475.115673:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111321344:12345-0@lo:400: Request processed in 29us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048475.115678:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1789048475.115692:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789048475.115706:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb4ed80 x1875953111321344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048475.115714:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111321344:0@lo:400: 00000100:00100000:2.0:1789048475.115740:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111320320:0@lo:400: 00000100:00100000:1.0:1789048475.125308:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111320576:12345-0@lo:400: Request processed in 13237us (20965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048475.125327:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789048475.125468:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111320192:12345-0@lo:400: Request processed in 22637us (23541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048475.125478:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1789048475.125528:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb4c000 x1875953111320192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048475.125544:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111320192:0@lo:400: 00000100:00100000:2.0:1789048475.126835:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111320576:0@lo:400: 00000100:00100000:3.0:1789048475.126864:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111321728:12345-0@lo:13: Request processed in 13807us (17978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048475.126881:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789048475.126922:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789048475.126938:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111321856:12345-0@lo:13: 00002000:00000024:3.0:1789048475.127454:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048475.127521:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111321856:12345-0@lo:13: Request processed in 589us (18579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048475.127527:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789048475.127740:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111320064:12345-0@lo:400: Request processed in 14478us (19991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048475.127752:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789048475.127902:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111320064:0@lo:400: 00010000:00080000:1.0:1789048475.128074:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c2b611880 x1875953111321856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048475.128100:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111321856:0@lo:13: 00010000:00080000:1.0:1789048475.128114:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07b11180 x1875953111321728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048475.128127:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111321728:0@lo:13: 00010000:00010000:3.0:1789048475.613797:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048475.614301:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789048475.614352:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111321984:0@lo:41: 00000100:00100000:3.0:1789048475.614479:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048475.614702:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111321984 00000100:00100000:0.0:1789048475.614713:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111321984 00000100:00100000:0.0:1789048475.614783:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789048475.614795:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111321984:12345-0@lo:41: 00000004:00000024:0.0:1789048475.614847:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789048475.614912:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111321984:12345-0@lo:41: Request processed in 120us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048475.614920:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789048475.615287:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111321984:0@lo:41: 00000100:00100000:1.0:1789048476.030105:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048476.030669:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097638272 00000100:00100000:2.0:1789048476.030685:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097638272 00000100:00100000:2.0:1789048476.030812:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 183 00000100:00100000:2.0:1789048476.030823:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2390:x1875953097638272:12345-192.168.202.16@tcp:250: 00010000:00080000:2.0:1789048476.030863:0:6492:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 79ddb626-b82d-4fee-93aa-3a1f146cc67d@192.168.202.16@tcp t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:2.0:1789048476.030901:0:6492:0:(genops.c:1384:class_connect()) connect: client 79ddb626-b82d-4fee-93aa-3a1f146cc67d, cookie 0x133f221c08775dbb 00000100:00080000:2.0:1789048476.031117:0:6492:0:(import.c:65:import_set_state_nolock()) ffff959b08017000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789048476.031211:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+5:2390:x1875953097638272:12345-192.168.202.16@tcp:250: Request processed in 386us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048476.031219:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 183 00000100:00100000:1.0:1789048476.038081:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048476.051858:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097638144 00000100:00100000:0.0:1789048476.051879:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097638144 00000100:00100000:0.0:1789048476.051956:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 184 00000100:00100000:0.0:1789048476.051967:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+5:6155:x1875953097638144:12345-192.168.202.16@tcp:101: 00010000:00010000:0.0:1789048476.051990:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048476.052026:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c420cd200/0x133f221c08775dc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29588 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048476.052065:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c420cd200/0x133f221c08775dc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29588 expref: 6 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048476.052105:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c420cd200/0x133f221c08775dc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29588 expref: 6 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048476.052118:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c420cd200, rc 0) 00000100:00100000:0.0:1789048476.052197:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+6:6155:x1875953097638144:12345-192.168.202.16@tcp:101: Request processed in 232us (14132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048476.052205:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 184 00000100:00100000:1.0:1789048476.063928:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048476.064037:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097638400 00000100:00100000:0.0:1789048476.064052:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097638400 00000100:00100000:0.0:1789048476.064124:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 185 00000100:00100000:0.0:1789048476.064137:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+6:6155:x1875953097638400:12345-192.168.202.16@tcp:501: 00000100:00100000:0.0:1789048476.064306:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+6:6155:x1875953097638400:12345-192.168.202.16@tcp:501: Request processed in 171us (393us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789048476.064315:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 185 00000100:00100000:1.0:1789048476.073497:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048476.073734:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097638528 00000100:00100000:3.0:1789048476.073749:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097638528 00000100:00100000:3.0:1789048476.073825:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 186 00000100:00100000:3.0:1789048476.073838:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+6:6155:x1875953097638528:12345-192.168.202.16@tcp:101: 00010000:00010000:3.0:1789048476.073860:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048476.073885:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef3d600/0x133f221c08775dc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b2958f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048476.073922:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3d600/0x133f221c08775dc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2958f expref: 7 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048476.073959:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef3d600/0x133f221c08775dc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2958f expref: 7 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048476.073970:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3d600, rc 0) 00000100:00100000:3.0:1789048476.074056:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+7:6155:x1875953097638528:12345-192.168.202.16@tcp:101: Request processed in 220us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048476.074064:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 186 00000100:00100000:1.0:1789048476.086872:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048476.087029:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097638656 00000100:00100000:2.0:1789048476.087046:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097638656 00000100:00100000:2.0:1789048476.087121:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 187 00000100:00100000:2.0:1789048476.087134:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+7:6155:x1875953097638656:12345-192.168.202.16@tcp:501: 00000100:00100000:2.0:1789048476.087413:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+8:6155:x1875953097638656:12345-192.168.202.16@tcp:501: Request processed in 280us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048476.087423:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 187 00000100:00100000:1.0:1789048476.103734:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048476.103872:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097638784 00000100:00100000:0.0:1789048476.103887:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097638784 00000100:00100000:0.0:1789048476.103977:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 188 00000100:00100000:0.0:1789048476.103990:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+8:6155:x1875953097638784:12345-192.168.202.16@tcp:503: 00000100:00100000:0.0:1789048476.104204:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+8:6155:x1875953097638784:12345-192.168.202.16@tcp:503: Request processed in 215us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048476.104213:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 188 00000100:00100000:1.0:1789048476.114489:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048476.114592:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097638912 00000100:00100000:3.0:1789048476.114605:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097638912 00000100:00100000:3.0:1789048476.114670:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 189 00000100:00100000:3.0:1789048476.114682:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+8:6173:x1875953097638912:12345-192.168.202.16@tcp:502: 00000100:00100000:3.0:1789048476.114903:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+8:6173:x1875953097638912:12345-192.168.202.16@tcp:502: Request processed in 222us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048476.114913:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 189 00000100:00100000:1.0:1789048476.126641:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111322112:0@lo:13: 00000100:00100000:1.0:1789048476.126738:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048476.129566:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111322112 00000100:00100000:3.0:1789048476.129586:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111322112 00000100:00100000:3.0:1789048476.129672:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789048476.129686:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111322112:12345-0@lo:13: 00002000:00000024:3.0:1789048476.129740:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048476.129865:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111322112:12345-0@lo:13: Request processed in 181us (3127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048476.129873:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789048476.131723:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111322240:0@lo:13: 00000100:00100000:1.0:1789048476.131818:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789048476.131946:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb4ce00 x1875953111322112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048476.131975:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111322112:0@lo:13: 00000100:00100000:3.0:1789048476.135492:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111322240 00000100:00100000:3.0:1789048476.135517:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111322240 00000100:00100000:3.0:1789048476.135615:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789048476.135628:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111322240:12345-0@lo:13: 00002000:00000024:3.0:1789048476.135681:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048476.135798:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111322240:12345-0@lo:13: Request processed in 172us (3980us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048476.135806:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1789048476.136011:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07b13800 x1875953111322240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048476.136038:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111322240:0@lo:13: 00000100:00100000:1.0:1789048476.171508:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048476.171891:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097639040 00000100:00100000:2.0:1789048476.171906:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097639040 00000100:00100000:2.0:1789048476.171994:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 190 00000100:00100000:2.0:1789048476.172007:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+8:6173:x1875953097639040:12345-192.168.202.16@tcp:502: 00000100:00100000:2.0:1789048476.172224:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+8:6173:x1875953097639040:12345-192.168.202.16@tcp:502: Request processed in 219us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048476.172243:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 190 00000100:00100000:1.0:1789048476.182720:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048476.182855:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097639168 00000100:00100000:0.0:1789048476.182869:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097639168 00000100:00100000:0.0:1789048476.182946:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 191 00000100:00100000:0.0:1789048476.182959:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+8:6155:x1875953097639168:12345-192.168.202.16@tcp:101: 00010000:00010000:0.0:1789048476.183012:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048476.183045:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c420cc000/0x133f221c08775dd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b295c0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048476.183083:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c420cc000/0x133f221c08775dd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b295c0 expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048476.183095:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c420cc000/0x133f221c08775dd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b295c0 expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048476.183105:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c420cc000, rc 0) 00000100:00100000:0.0:1789048476.183181:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+9:6155:x1875953097639168:12345-192.168.202.16@tcp:101: Request processed in 225us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048476.183188:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 191 00000100:00100000:1.0:1789048476.188703:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048476.188935:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097639296 00000100:00100000:3.0:1789048476.188950:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097639296 00000100:00100000:3.0:1789048476.189047:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 192 00000100:00100000:3.0:1789048476.189063:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+9:6155:x1875953097639296:12345-192.168.202.16@tcp:256: 20000000:01000000:3.0:1789048476.189102:0:6490:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789048476.189138:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789048476.189143:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789048476.189146:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789048476.189149:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789048476.189152:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1789048476.193912:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+9:6155:x1875953097639296:12345-192.168.202.16@tcp:256: Request processed in 4835us (5218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048476.193933:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 192 00000100:00100000:1.0:1789048476.209278:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048476.209889:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097639424 00000100:00100000:2.0:1789048476.209907:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097639424 00000100:00100000:2.0:1789048476.210045:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 193 00000100:00100000:2.0:1789048476.210058:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+9:6155:x1875953097639424:12345-192.168.202.16@tcp:101: 00010000:00010000:2.0:1789048476.210083:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048476.210108:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c02837400/0x133f221c08775dd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b295c7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048476.210144:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c02837400/0x133f221c08775dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b295c7 expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048476.210157:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c02837400/0x133f221c08775dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b295c7 expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048476.210168:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02837400, rc 0) 00000100:00100000:2.0:1789048476.210244:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:6155:x1875953097639424:12345-192.168.202.16@tcp:101: Request processed in 189us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048476.210250:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 193 00000100:00100000:1.0:1789048476.214183:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048476.214405:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097639552 00000100:00100000:3.0:1789048476.214420:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097639552 00000100:00100000:3.0:1789048476.214684:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 194 00000100:00100000:3.0:1789048476.214698:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:6155:x1875953097639552:12345-192.168.202.16@tcp:501: 00000100:00100000:3.0:1789048476.215250:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:6155:x1875953097639552:12345-192.168.202.16@tcp:501: Request processed in 553us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048476.215259:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 194 00000100:00100000:1.0:1789048476.219714:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048476.220300:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097639680 00000100:00100000:2.0:1789048476.220314:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097639680 00000100:00100000:2.0:1789048476.220440:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 195 00000100:00100000:2.0:1789048476.220454:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:6155:x1875953097639680:12345-192.168.202.16@tcp:503: 00000100:00100000:2.0:1789048476.220668:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:6155:x1875953097639680:12345-192.168.202.16@tcp:503: Request processed in 216us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048476.220677:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 195 00000100:00100000:1.0:1789048476.232029:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048476.232139:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097639808 00000100:00100000:3.0:1789048476.232153:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097639808 00000100:00100000:3.0:1789048476.232226:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 196 00000100:00100000:3.0:1789048476.232256:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:6180:x1875953097639808:12345-192.168.202.16@tcp:502: 00000100:00100000:0.0:1789048476.234162:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:6180:x1875953097639808:12345-192.168.202.16@tcp:502: Request processed in 1892us (2133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048476.234180:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 196 00000100:00100000:1.0:1789048476.243434:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048476.243664:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097639936 00000100:00100000:0.0:1789048476.243679:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097639936 00000100:00100000:0.0:1789048476.243760:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 197 00000100:00100000:0.0:1789048476.244600:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:6180:x1875953097639936:12345-192.168.202.16@tcp:502: 00000100:00100000:0.0:1789048476.244846:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:6180:x1875953097639936:12345-192.168.202.16@tcp:502: Request processed in 1075us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048476.244856:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 197 00000100:00100000:1.0:1789048476.253006:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048476.253190:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097640064 00000100:00100000:2.0:1789048476.253224:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097640064 00000100:00100000:2.0:1789048476.253293:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:2.0:1789048476.253304:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1875953097640064:12345-192.168.202.16@tcp:38: 00010000:00080000:2.0:1789048476.253413:0:8649:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:2.0:1789048476.253501:0:8649:0:(genops.c:1384:class_connect()) connect: client 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b, cookie 0x133f221c08775dde 00000004:00100000:2.0:1789048476.253540:0:8649:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789048476.254544:0:8649:0:(import.c:65:import_set_state_nolock()) ffff959b08014000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789048476.254644:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2390:x1875953097640064:12345-192.168.202.16@tcp:38: Request processed in 1337us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048476.254654:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:1.0:1789048476.258320:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048476.258590:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097640320 00000100:00100000:2.0:1789048476.258604:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097640320 00000100:00100000:2.0:1789048476.258701:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:2.0:1789048476.258711:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1875953097640320:12345-192.168.202.16@tcp:38: 00010000:00080000:2.0:1789048476.258752:0:6497:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:2.0:1789048476.258863:0:6497:0:(genops.c:1384:class_connect()) connect: client 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b, cookie 0x133f221c08775de5 00000004:00100000:2.0:1789048476.258902:0:6497:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789048476.259185:0:6497:0:(import.c:65:import_set_state_nolock()) ffff959b08012800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789048476.259320:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2390:x1875953097640320:12345-192.168.202.16@tcp:38: Request processed in 608us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048476.259328:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00010000:00010000:1.0:1789048476.641027:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048477.151881:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789048477.151919:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111322368:0@lo:41: 00000100:00100000:0.0:1789048477.152023:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048477.152756:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111322368 00000100:00100000:2.0:1789048477.152769:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111322368 00000100:00100000:2.0:1789048477.152848:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789048477.152860:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111322368:12345-0@lo:41: 00000004:00000024:2.0:1789048477.152909:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789048477.153004:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111322368:12345-0@lo:41: Request processed in 146us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048477.153011:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789048477.153178:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111322368:0@lo:41: 00000100:00100000:3.0:1789048477.265464:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048477.265613:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097640192 00000100:00100000:0.0:1789048477.265626:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097640192 00000100:00100000:0.0:1789048477.265721:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:0.0:1789048477.265736:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:0:x1875953097640192:12345-192.168.202.16@tcp:41: 00000004:00000024:0.0:1789048477.265796:0:8649:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789048477.265880:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:0:x1875953097640192:12345-192.168.202.16@tcp:41: Request processed in 146us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048477.265888:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00080000:2.0:1789048477.266206:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048477.268647:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048477.268689:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048477.268888:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097640576 00000100:00100000:1.0:1789048477.268919:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097640576 00000100:00100000:1.0:1789048477.268992:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097640448 00000100:00100000:1.0:1789048477.268995:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097640448 00000100:00100000:1.0:1789048477.269053:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:1.0:1789048477.269065:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:6155:x1875953097640576:12345-192.168.202.16@tcp:41: 00000004:00000024:1.0:1789048477.269112:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789048477.269209:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:6155:x1875953097640576:12345-192.168.202.16@tcp:41: Request processed in 146us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048477.269218:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:1.0:1789048477.269239:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:1.0:1789048477.269245:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:0:x1875953097640448:12345-192.168.202.16@tcp:41: 00000004:00000024:1.0:1789048477.269266:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789048477.269289:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:0:x1875953097640448:12345-192.168.202.16@tcp:41: Request processed in 45us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048477.269295:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00080000:3.0:1789048477.269787:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048477.272801:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048477.272982:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097640704 00000100:00100000:1.0:1789048477.272995:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097640704 00000100:00100000:1.0:1789048477.273268:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:1.0:1789048477.273282:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:6155:x1875953097640704:12345-192.168.202.16@tcp:40: 00000100:00100000:1.0:1789048477.273576:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:6155:x1875953097640704:12345-192.168.202.16@tcp:40: Request processed in 297us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048477.273585:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:1.0:1789048477.285982:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048477.286032:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048477.286077:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048477.286192:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097641088 00000100:00100000:3.0:1789048477.286205:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097641088 00000100:00100000:3.0:1789048477.286274:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:3.0:1789048477.286288:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:6155:x1875953097641088:12345-192.168.202.16@tcp:900: 00000100:00100000:3.0:1789048477.286438:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:6155:x1875953097641088:12345-192.168.202.16@tcp:900: Request processed in 155us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048477.286445:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:0.0:1789048477.289040:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097640832 00000100:00100000:0.0:1789048477.289064:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097640832 00000100:00100000:0.0:1789048477.289137:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097640960 00000100:00100000:0.0:1789048477.289141:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097640960 00000100:00100000:0.0:1789048477.289178:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:0.0:1789048477.289196:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1875953097640832:12345-192.168.202.16@tcp:8: 00010000:00080000:0.0:1789048477.289238:0:8412:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:0.0:1789048477.289274:0:8412:0:(genops.c:1384:class_connect()) connect: client 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b, cookie 0x133f221c08775dec 00002000:00100000:0.0:1789048477.289287:0:8412:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b/ffff959b08029800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789048477.289305:0:8412:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789048477.289514:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:2.0:1789048477.289521:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1875953097640960:12345-192.168.202.16@tcp:8: 00010000:00080000:2.0:1789048477.289542:0:8414:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:2.0:1789048477.289566:0:8414:0:(genops.c:1384:class_connect()) connect: client 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b, cookie 0x133f221c08775df3 00002000:00100000:2.0:1789048477.289572:0:8414:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b/ffff959b08015800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789048477.289587:0:8414:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789048477.289817:0:8414:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789048477.289941:0:8414:0:(import.c:65:import_set_state_nolock()) ffff959b0758c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789048477.290067:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2390:x1875953097640960:12345-192.168.202.16@tcp:8: Request processed in 543us (3988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048477.290077:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00002000:00080000:0.0:1789048477.290098:0:8412:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789048477.290115:0:8412:0:(import.c:65:import_set_state_nolock()) ffff959b08028000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789048477.290141:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2390:x1875953097640832:12345-192.168.202.16@tcp:8: Request processed in 946us (4178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048477.290148:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:1.0:1789048477.294128:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048477.294458:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048477.294556:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097641216 00000100:00100000:0.0:1789048477.294569:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097641216 00000100:00100000:0.0:1789048477.294646:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 198 00000100:00100000:0.0:1789048477.294658:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2392:x1875953097641216:12345-192.168.202.16@tcp:400: 00000100:00100000:0.0:1789048477.294927:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2392:x1875953097641216:12345-192.168.202.16@tcp:400: Request processed in 269us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048477.294937:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 198 00000100:00100000:2.0:1789048477.295067:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097641344 00000100:00100000:2.0:1789048477.295072:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097641344 00000100:00100000:2.0:1789048477.295118:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:2.0:1789048477.295127:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:6155:x1875953097641344:12345-192.168.202.16@tcp:33: 00000004:00080000:2.0:1789048477.317514:0:6500:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 22257us 00000004:00200000:0.0:1789048477.360621:0:6500:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789048477.360736:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:6155:x1875953097641344:12345-192.168.202.16@tcp:33: Request processed in 65605us (66273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048477.360750:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:1.0:1789048477.585760:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048477.586735:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097641472 00000100:00100000:2.0:1789048477.586748:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097641472 00000100:00100000:2.0:1789048477.586821:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:2.0:1789048477.586832:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:6199:x1875953097641472:12345-192.168.202.16@tcp:101: 00010000:00010000:2.0:1789048477.586855:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048477.586948:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08775dfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b295f8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048477.587017:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08775e01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048477.587032:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08775e01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048477.587047:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08775e01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048477.587089:0:6497:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789048477.587093:0:6497:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789048477.587109:0:6497:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08775e01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048477.587134:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08775dfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b295f8 expref: 8 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048477.587152:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08775e01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b295f8 expref: 7 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048477.587161:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c05322500) 00010000:00010000:2.0:1789048477.587164:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789048477.587167:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02836600, rc 0) 00000100:00100000:2.0:1789048477.587821:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:6199:x1875953097641472:12345-192.168.202.16@tcp:101: Request processed in 986us (2067us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048477.587830:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00010000:00010000:1.0:1789048477.662051:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048478.687004:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048479.709648:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048480.194482:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048480.197418:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097641600 00000100:00100000:0.0:1789048480.197442:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097641600 00000100:00100000:0.0:1789048480.197560:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:0.0:1789048480.197576:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:6251:x1875953097641600:12345-192.168.202.16@tcp:41: 00000004:00000024:0.0:1789048480.199537:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789048480.200044:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:6251:x1875953097641600:12345-192.168.202.16@tcp:41: Request processed in 2465us (5569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048480.200058:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00080000:3.0:1789048480.200239:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048480.207058:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048480.207297:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097641728 00000100:00100000:0.0:1789048480.207311:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097641728 00000100:00100000:0.0:1789048480.207464:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:0.0:1789048480.207479:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:6251:x1875953097641728:12345-192.168.202.16@tcp:41: 00000004:00000024:0.0:1789048480.207549:0:8649:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789048480.207656:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:6251:x1875953097641728:12345-192.168.202.16@tcp:41: Request processed in 172us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048480.207666:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00080000:3.0:1789048480.209904:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789048480.212090:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048480.212685:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097641856 00000100:00100000:3.0:1789048480.212701:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097641856 00000100:00080000:2.0:1789048480.212967:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789048480.213117:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:3.0:1789048480.213135:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:6251:x1875953097641856:12345-192.168.202.16@tcp:13: 00002000:00000024:3.0:1789048480.213181:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048480.213280:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:6251:x1875953097641856:12345-192.168.202.16@tcp:13: Request processed in 149us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048480.221057:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:2.0:1789048480.221299:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048480.221721:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789048480.221746:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111322496:0@lo:13: 00000100:00100000:1.0:1789048480.226410:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097641984 00000100:00100000:1.0:1789048480.226433:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097641984 00000100:00100000:1.0:1789048480.226532:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:1.0:1789048480.226548:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:6251:x1875953097641984:12345-192.168.202.16@tcp:13: 00002000:00000024:1.0:1789048480.226589:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789048480.232583:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789048480.233908:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789048480.233948:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111322624:0@lo:13: 00000100:00100000:2.0:1789048480.240411:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111322880:0@lo:400: 00000100:00100000:0.0:1789048480.243436:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048480.243570:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111323008:0@lo:400: 00000100:00100000:3.0:1789048480.244258:0:8416:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1789048480.244277:0:8416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1789048480.244445:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111322624 00000100:00100000:3.0:1789048480.244455:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111322624 00000100:00100000:1.0:1789048480.244722:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111322752:0@lo:400: 00000100:00100000:1.0:1789048480.244898:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048480.244941:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111323264:0@lo:400: 00000100:00100000:1.0:1789048480.244969:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048480.244988:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111323776:0@lo:400: 00000100:00100000:2.0:1789048480.244995:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111322752 00000100:00100000:2.0:1789048480.245000:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111322752 00000100:00100000:1.0:1789048480.245012:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048480.245034:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789048480.245038:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789048480.245040:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111323392:0@lo:400: 00000100:00100000:1.0:1789048480.245065:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048480.245085:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111323904:0@lo:400: 00000100:00100000:1.0:1789048480.245107:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048480.245136:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111323264 00000100:00100000:1.0:1789048480.245140:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111323264 00000100:00100000:2.0:1789048480.245205:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111322752:12345-0@lo:400: 00000100:00100000:0.0:1789048480.245246:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048480.245265:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111322752:12345-0@lo:400: Request processed in 65us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048480.245273:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789048480.245275:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111323520:0@lo:400: 00000100:00100000:0.0:1789048480.245298:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048480.245438:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789048480.245447:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111322624:12345-0@lo:13: 00002000:00000024:3.0:1789048480.245467:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048480.245504:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111322624:12345-0@lo:13: Request processed in 59us (2080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048480.245510:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789048480.245681:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111324032:0@lo:400: 00000100:00100000:0.0:1789048480.245707:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789048480.245745:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb2dc00 x1875953111322624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048480.245768:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111322624:0@lo:13: 00000001:00100000:2.0:1789048480.245954:0:9492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 00000100:00100000:0.0:1789048480.245967:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789048480.245974:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111323136:0@lo:400: 00000100:00100000:2.0:1789048480.245975:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111323776 00000100:00100000:2.0:1789048480.245980:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111323776 00000100:00100000:0.0:1789048480.246000:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048480.246013:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789048480.246013:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111323648:0@lo:400: 00000100:00100000:2.0:1789048480.246020:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111323776:12345-0@lo:400: 00000100:00100000:0.0:1789048480.246033:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048480.246051:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111324160:0@lo:400: 00000100:00100000:0.0:1789048480.246073:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048480.246103:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111323008 00000100:00100000:0.0:1789048480.246107:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111323008 00000100:00100000:0.0:1789048480.246131:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789048480.246138:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111323264:12345-0@lo:400: 00000100:00100000:0.0:1789048480.246186:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111323264:12345-0@lo:400: Request processed in 48us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048480.246192:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789048480.246206:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789048480.246221:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111323008:12345-0@lo:400: 00000100:00100000:0.0:1789048480.246257:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111323008:12345-0@lo:400: Request processed in 37us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048480.246263:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789048480.246283:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111323392 00000100:00100000:0.0:1789048480.246287:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111323392 00000100:00100000:0.0:1789048480.246306:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111323904 00000100:00100000:0.0:1789048480.246309:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111323904 00000100:00100000:0.0:1789048480.246355:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111323520 00000100:00100000:0.0:1789048480.246358:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111323520 00000100:00100000:0.0:1789048480.246372:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111324032 00000100:00100000:0.0:1789048480.246375:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111324032 00000100:00100000:0.0:1789048480.246387:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111323136 00000100:00100000:0.0:1789048480.246390:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111323136 00000100:00100000:3.0:1789048480.246398:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048480.246402:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789048480.246408:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111323392:12345-0@lo:400: 00000100:00100000:3.0:1789048480.246432:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111322880 00000100:00100000:3.0:1789048480.246436:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111322880 00000100:00100000:0.0:1789048480.246438:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111323392:12345-0@lo:400: Request processed in 31us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048480.246444:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789048480.246453:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789048480.246458:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111323904:12345-0@lo:400: 00000100:00100000:0.0:1789048480.246665:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789048480.246675:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111323520:12345-0@lo:400: 00000100:00100000:0.0:1789048480.246709:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111323520:12345-0@lo:400: Request processed in 36us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048480.246716:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789048480.246728:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789048480.246734:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111324032:12345-0@lo:400: 00000100:00100000:0.0:1789048480.246791:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111324032:12345-0@lo:400: Request processed in 45us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048480.246807:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789048480.246819:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789048480.246826:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111323136:12345-0@lo:400: 00000100:00100000:0.0:1789048480.246854:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111323136:12345-0@lo:400: Request processed in 29us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048480.246860:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789048480.246870:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789048480.246877:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111322880:12345-0@lo:400: 00000100:00100000:0.0:1789048480.246911:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111322880:12345-0@lo:400: Request processed in 35us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048480.246917:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789048480.246930:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111323776:12345-0@lo:400: Request processed in 909us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048480.246936:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111323648 00000100:00100000:2.0:1789048480.246937:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789048480.246939:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111323648 00000100:00100000:2.0:1789048480.246948:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111324160 00000100:00100000:2.0:1789048480.246950:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111324160 00000100:00100000:0.0:1789048480.246958:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789048480.246964:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111323648:12345-0@lo:400: 00000100:00100000:2.0:1789048480.246965:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789048480.246970:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111324160:12345-0@lo:400: 00000100:00100000:2.0:1789048480.246992:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111324160:12345-0@lo:400: Request processed in 23us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048480.246992:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111323648:12345-0@lo:400: Request processed in 28us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048480.246999:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789048480.247097:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048480.247139:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111322496 00000100:00100000:1.0:1789048480.247149:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111322496 00000100:00100000:1.0:1789048480.247188:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789048480.247195:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111322496:12345-0@lo:13: 00002000:00000024:1.0:1789048480.247210:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048480.247247:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111322496:12345-0@lo:13: Request processed in 54us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048480.247252:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789048480.247281:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07b10e00 x1875953111322496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048480.247299:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111322496:0@lo:13: 00000100:00100000:2.0:1789048480.247359:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111323392:0@lo:400: 00000100:00100000:2.0:1789048480.247371:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111322752:0@lo:400: 00000100:00100000:2.0:1789048480.247382:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111323264:0@lo:400: 00000100:00100000:1.0:1789048480.247390:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:6251:x1875953097641984:12345-192.168.202.16@tcp:13: Request processed in 20845us (26090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048480.247397:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00010000:00080000:2.0:1789048480.247399:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb4c380 x1875953111323776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048480.247408:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111323776:0@lo:400: 00000100:00100000:2.0:1789048480.247473:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111322880:0@lo:400: 00000100:00080000:1.0:1789048480.247559:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789048480.247564:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789048480.247568:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789048480.247570:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789048480.247703:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111323136:0@lo:400: 00010000:00080000:1.0:1789048480.247716:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb4f480 x1875953111323648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048480.247725:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111323648:0@lo:400: 00010000:00080000:1.0:1789048480.247735:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb55500 x1875953111324160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048480.247744:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111324160:0@lo:400: 00010000:00080000:1.0:1789048480.247755:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb4e680 x1875953111323520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048480.247772:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111323520:0@lo:400: 00000100:00100000:3.0:1789048480.247942:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111323904:12345-0@lo:400: Request processed in 1482us (2832us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048480.247950:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1789048480.247952:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb56d80 x1875953111324032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048480.247960:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111324032:0@lo:400: 00000100:00100000:1.0:1789048480.247972:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111323008:0@lo:400: 00000100:00100000:0.0:1789048480.248485:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789048480.248709:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111323904:0@lo:400: 00010000:00010000:1.0:1789048480.735381:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048480.749492:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789048480.749530:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111324288:0@lo:41: 00000100:00100000:0.0:1789048480.749630:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048480.749720:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111324288 00000100:00100000:0.0:1789048480.749730:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111324288 00000100:00100000:0.0:1789048480.749797:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789048480.749809:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111324288:12345-0@lo:41: 00000004:00000024:0.0:1789048480.749855:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789048480.749920:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111324288:12345-0@lo:41: Request processed in 113us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048480.749928:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789048480.749985:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111324288:0@lo:41: 00000100:00100000:0.0:1789048481.259315:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111324544:0@lo:13: 00000100:00100000:0.0:1789048481.259451:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048481.259719:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111324544 00000100:00100000:3.0:1789048481.259730:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111324544 00000100:00100000:3.0:1789048481.259816:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789048481.259830:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111324544:12345-0@lo:13: 00002000:00000024:3.0:1789048481.259874:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048481.259934:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111324544:12345-0@lo:13: Request processed in 108us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048481.259942:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789048481.260023:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111324416:0@lo:13: 00000100:00100000:1.0:1789048481.260062:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048481.260754:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111324416 00000100:00100000:3.0:1789048481.260778:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111324416 00000100:00100000:3.0:1789048481.260831:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789048481.260841:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111324416:12345-0@lo:13: 00002000:00000024:3.0:1789048481.260879:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048481.260932:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111324416:12345-0@lo:13: Request processed in 94us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048481.260939:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789048481.261078:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb57800 x1875953111324544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048481.261103:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111324544:0@lo:13: 00010000:00080000:1.0:1789048481.261194:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07b10e00 x1875953111324416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048481.261207:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111324416:0@lo:13: 00010000:00010000:3.0:1789048481.757510:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048482.270568:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111324672:0@lo:41: 00000100:00100000:1.0:1789048482.270669:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048482.270827:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111324672 00000100:00100000:2.0:1789048482.270839:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111324672 00000100:00100000:2.0:1789048482.270910:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789048482.270922:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111324672:12345-0@lo:41: 00000004:00000024:2.0:1789048482.270968:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789048482.271024:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111324672:12345-0@lo:41: Request processed in 104us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048482.271031:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789048482.271134:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111324672:0@lo:41: 00000001:00100000:0.0:1789048482.273261:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 00000001:00100000:3.0:1789048482.273586:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 00000100:00100000:1.0:1789048482.365672:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048482.365745:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048482.365792:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048482.365818:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048482.365844:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048482.365878:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097642112 00000100:00100000:1.0:1789048482.365890:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097642112 00000100:00100000:1.0:1789048482.365966:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 200 00000100:00100000:1.0:1789048482.365979:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2392:x1875953097642112:12345-192.168.202.16@tcp:400: 00000100:00100000:1.0:1789048482.366093:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2392:x1875953097642112:12345-192.168.202.16@tcp:400: Request processed in 117us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048482.366102:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 200 00000100:00100000:1.0:1789048482.366143:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097642240 00000100:00100000:1.0:1789048482.366147:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097642240 00000100:00100000:1.0:1789048482.366184:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097642368 00000100:00100000:1.0:1789048482.366187:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097642368 00000100:00100000:1.0:1789048482.366208:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:1.0:1789048482.366215:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2392:x1875953097642240:12345-192.168.202.16@tcp:400: 00000100:00100000:1.0:1789048482.366249:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2392:x1875953097642240:12345-192.168.202.16@tcp:400: Request processed in 35us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048482.366256:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:1.0:1789048482.366268:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:1.0:1789048482.366274:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2392:x1875953097642368:12345-192.168.202.16@tcp:400: 00000100:00100000:1.0:1789048482.366310:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2392:x1875953097642368:12345-192.168.202.16@tcp:400: Request processed in 36us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048482.366317:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:3.0:1789048482.366507:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097642496 00000100:00100000:3.0:1789048482.366512:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097642496 00000100:00100000:3.0:1789048482.366545:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097642624 00000100:00100000:3.0:1789048482.366548:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097642624 00000100:00100000:3.0:1789048482.366573:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:3.0:1789048482.366581:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2392:x1875953097642496:12345-192.168.202.16@tcp:400: 00000100:00100000:3.0:1789048482.366612:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2392:x1875953097642496:12345-192.168.202.16@tcp:400: Request processed in 33us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048482.366628:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:3.0:1789048482.366643:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:3.0:1789048482.366650:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2392:x1875953097642624:12345-192.168.202.16@tcp:400: 00000100:00100000:3.0:1789048482.366676:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2392:x1875953097642624:12345-192.168.202.16@tcp:400: Request processed in 26us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048482.366682:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00080000:1.0:1789048482.367550:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789048482.367558:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789048482.367562:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789048482.367565:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789048482.781747:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789048483.302858:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 00000001:02000400:1.0:1789048483.328157:0:10165:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789048483.805761:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048484.829521:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048485.341494:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789048485.341519:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111324800:0@lo:13: 00000100:00100000:1.0:1789048485.341602:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048485.341965:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111325312:0@lo:400: 00000100:00100000:0.0:1789048485.341996:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048485.342017:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111325824:0@lo:400: 00000100:00100000:0.0:1789048485.342040:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048485.342058:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111326336:0@lo:400: 00000100:00100000:0.0:1789048485.342077:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048485.342100:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789048485.342106:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111324928:0@lo:400: 00000100:00100000:0.0:1789048485.342134:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048485.342155:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111325440:0@lo:400: 00000100:00100000:0.0:1789048485.342175:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048485.342191:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111325952:0@lo:400: 00000100:00100000:0.0:1789048485.342225:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048485.342251:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111326464:0@lo:13: 00000100:00100000:0.0:1789048485.342283:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048485.342308:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111325056:0@lo:400: 00000100:00100000:0.0:1789048485.342329:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048485.342366:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06970a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111325568:0@lo:400: 00000100:00100000:0.0:1789048485.342387:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048485.342403:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111326080:0@lo:400: 00000100:00100000:0.0:1789048485.342422:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048485.342439:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789048485.342444:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111325184:0@lo:400: 00000100:00100000:0.0:1789048485.343132:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048485.343155:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111325696:0@lo:400: 00000100:00100000:0.0:1789048485.343176:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048485.343187:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111326208:0@lo:400: 00000100:00100000:0.0:1789048485.343205:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048485.343252:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111325312 00000100:00100000:0.0:1789048485.343259:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111325312 00000100:00100000:0.0:1789048485.343304:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111325056 00000100:00100000:0.0:1789048485.343308:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111325056 00000100:00100000:0.0:1789048485.343320:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111325568 00000100:00100000:0.0:1789048485.343322:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111325568 00000100:00100000:0.0:1789048485.343360:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111326080 00000100:00100000:0.0:1789048485.343364:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111326080 00000100:00100000:0.0:1789048485.343377:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111325696 00000100:00100000:0.0:1789048485.343380:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111325696 00000100:00100000:0.0:1789048485.343390:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111326208 00000100:00100000:0.0:1789048485.343392:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111326208 00000100:00100000:0.0:1789048485.343407:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789048485.343414:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111325312:12345-0@lo:400: 00000100:00100000:0.0:1789048485.343474:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111325312:12345-0@lo:400: Request processed in 60us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048485.343482:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789048485.343498:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789048485.343504:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111325056:12345-0@lo:400: 00000100:00100000:0.0:1789048485.343532:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111325056:12345-0@lo:400: Request processed in 29us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048485.343538:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789048485.343548:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789048485.343554:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111325568:12345-0@lo:400: 00000100:00100000:0.0:1789048485.343576:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111325568:12345-0@lo:400: Request processed in 22us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048485.343581:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789048485.343589:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789048485.343594:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111326080:12345-0@lo:400: 00000100:00100000:0.0:1789048485.343620:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111326080:12345-0@lo:400: Request processed in 25us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048485.343624:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789048485.343634:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789048485.343639:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111325696:12345-0@lo:400: 00000100:00100000:0.0:1789048485.343663:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111325696:12345-0@lo:400: Request processed in 24us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048485.343668:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789048485.343678:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789048485.343684:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111326208:12345-0@lo:400: 00000100:00100000:0.0:1789048485.343720:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111326208:12345-0@lo:400: Request processed in 37us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048485.343726:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789048485.343747:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111325824 00000100:00100000:0.0:1789048485.343751:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111325824 00000100:00100000:0.0:1789048485.343777:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111326336 00000100:00100000:0.0:1789048485.343780:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111326336 00000100:00100000:0.0:1789048485.343792:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111325952 00000100:00100000:0.0:1789048485.343795:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111325952 00000100:00100000:0.0:1789048485.343808:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789048485.343813:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111325824:12345-0@lo:400: 00000100:00100000:0.0:1789048485.343845:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111325824:12345-0@lo:400: Request processed in 31us (1804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048485.343850:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789048485.343860:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789048485.343866:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111326336:12345-0@lo:400: 00000100:00100000:0.0:1789048485.343890:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111326336:12345-0@lo:400: Request processed in 25us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048485.343895:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789048485.343903:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789048485.343909:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111325952:12345-0@lo:400: 00000100:00100000:0.0:1789048485.343931:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111325952:12345-0@lo:400: Request processed in 24us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048485.343936:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789048485.343956:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111324928 00000100:00100000:0.0:1789048485.343959:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111324928 00000100:00100000:0.0:1789048485.343981:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789048485.343986:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111324928:12345-0@lo:400: 00000100:00100000:0.0:1789048485.344020:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111324928:12345-0@lo:400: Request processed in 33us (1886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048485.344025:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789048485.344069:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111325440 00000100:00100000:0.0:1789048485.344074:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111325440 00000100:00100000:0.0:1789048485.344095:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111325184 00000100:00100000:0.0:1789048485.344098:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111325184 00000100:00100000:0.0:1789048485.344109:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789048485.344115:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111325440:12345-0@lo:400: 00000100:00100000:0.0:1789048485.344146:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111325440:12345-0@lo:400: Request processed in 33us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048485.344151:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789048485.344160:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789048485.344166:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111325184:12345-0@lo:400: 00000100:00100000:0.0:1789048485.344204:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111325184:12345-0@lo:400: Request processed in 38us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048485.344209:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789048485.344232:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111324800 00000100:00100000:0.0:1789048485.344236:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111324800 00000100:00100000:0.0:1789048485.344259:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111326464 00000100:00100000:0.0:1789048485.344262:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111326464 00000100:00100000:0.0:1789048485.344289:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789048485.344296:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111324800:12345-0@lo:13: 00002000:00000024:0.0:1789048485.344316:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048485.344373:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111324800:12345-0@lo:13: Request processed in 77us (2777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048485.344378:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789048485.344395:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789048485.344401:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111326464:12345-0@lo:13: 00002000:00000024:0.0:1789048485.344410:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048485.344434:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111326464:12345-0@lo:13: Request processed in 34us (2151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048485.344439:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789048485.344569:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb31180 x1875953111324800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048485.344588:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111324800:0@lo:13: 00000100:00100000:0.0:1789048485.344621:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111325184:0@lo:400: 00010000:00080000:0.0:1789048485.344631:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b06971880 x1875953111325696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048485.344639:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111325696:0@lo:400: 00010000:00080000:0.0:1789048485.344648:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb2a300 x1875953111326208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048485.344655:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111326208:0@lo:400: 00000100:00100000:0.0:1789048485.344664:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111325056:0@lo:400: 00000100:00100000:0.0:1789048485.344678:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06970a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111325568:0@lo:400: 00000100:00100000:0.0:1789048485.344687:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111326080:0@lo:400: 00000100:00100000:0.0:1789048485.344718:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111324928:0@lo:400: 00000100:00100000:0.0:1789048485.344728:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111325440:0@lo:400: 00010000:00080000:0.0:1789048485.344738:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb28a80 x1875953111325952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048485.344753:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111325952:0@lo:400: 00010000:00080000:0.0:1789048485.344767:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb2ad80 x1875953111326464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048485.344778:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111326464:0@lo:13: 00000100:00100000:0.0:1789048485.344788:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111325312:0@lo:400: 00010000:00080000:0.0:1789048485.344797:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b06972680 x1875953111325824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048485.344803:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111325824:0@lo:400: 00010000:00080000:0.0:1789048485.344811:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb28380 x1875953111326336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048485.344818:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111326336:0@lo:400: 00000100:00080000:1.0:1789048485.345077:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789048485.345089:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789048485.345092:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789048485.345093:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789048485.854004:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048485.855060:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111326592:0@lo:41: 00000100:00100000:0.0:1789048485.855130:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048485.855233:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111326592 00000100:00100000:1.0:1789048485.855242:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111326592 00000100:00100000:1.0:1789048485.855311:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789048485.855321:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111326592:12345-0@lo:41: 00000004:00000024:1.0:1789048485.855441:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789048485.855596:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111326592:12345-0@lo:41: Request processed in 275us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048485.855607:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111326592:0@lo:41: 00000100:00100000:1.0:1789048485.855608:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789048486.367989:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111326720:0@lo:13: 00000100:00100000:0.0:1789048486.368058:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048486.368122:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111326720 00000100:00100000:0.0:1789048486.368130:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111326720 00000100:00100000:0.0:1789048486.368187:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789048486.368196:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111326720:12345-0@lo:13: 00002000:00000024:0.0:1789048486.368223:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048486.368277:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111326720:12345-0@lo:13: Request processed in 81us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048486.368291:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1789048486.368377:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb2ad80 x1875953111326720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048486.368397:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111326720:0@lo:13: 00000100:00100000:3.0:1789048486.370689:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111326848:0@lo:13: 00000100:00100000:3.0:1789048486.370750:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048486.371017:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111326848 00000100:00100000:2.0:1789048486.371026:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111326848 00000100:00100000:2.0:1789048486.371076:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789048486.371085:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111326848:12345-0@lo:13: 00002000:00000024:2.0:1789048486.371105:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789048486.371148:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111326848:12345-0@lo:13: Request processed in 64us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048486.371155:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789048486.371203:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb54e00 x1875953111326848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048486.371221:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111326848:0@lo:13: 00010000:00010000:0.0:1789048486.878527:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048487.389743:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111326976:0@lo:41: 00000100:00100000:3.0:1789048487.389873:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048487.389990:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111326976 00000100:00100000:1.0:1789048487.389998:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111326976 00000100:00100000:1.0:1789048487.390044:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789048487.390053:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111326976:12345-0@lo:41: 00000004:00000024:1.0:1789048487.390088:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789048487.390135:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111326976:12345-0@lo:41: Request processed in 84us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048487.390142:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789048487.390620:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111326976:0@lo:41: 00000100:00100000:1.0:1789048487.489257:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048487.489374:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048487.489401:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048487.489421:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048487.489456:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048487.490205:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097643008 00000100:00100000:0.0:1789048487.490216:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097643008 00000100:00100000:0.0:1789048487.490289:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097642880 00000100:00100000:0.0:1789048487.490301:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097642880 00000100:00100000:0.0:1789048487.490328:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:0.0:1789048487.490359:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097643008:12345-192.168.202.16@tcp:400: 00000100:00100000:0.0:1789048487.490438:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097643008:12345-192.168.202.16@tcp:400: Request processed in 82us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048487.490446:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:0.0:1789048487.490463:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:0.0:1789048487.490469:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097642880:12345-192.168.202.16@tcp:400: 00000100:00100000:0.0:1789048487.490492:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097642880:12345-192.168.202.16@tcp:400: Request processed in 23us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048487.490498:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:0.0:1789048487.490517:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097643264 00000100:00100000:0.0:1789048487.490520:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097643264 00000100:00100000:0.0:1789048487.490543:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097643136 00000100:00100000:0.0:1789048487.490546:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097643136 00000100:00100000:0.0:1789048487.490563:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:0.0:1789048487.490569:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097643264:12345-192.168.202.16@tcp:400: 00000100:00100000:0.0:1789048487.490604:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097643264:12345-192.168.202.16@tcp:400: Request processed in 35us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048487.490617:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:0.0:1789048487.490630:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:0.0:1789048487.490637:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097643136:12345-192.168.202.16@tcp:400: 00000100:00100000:0.0:1789048487.490662:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097643136:12345-192.168.202.16@tcp:400: Request processed in 25us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048487.490667:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00080000:1.0:1789048487.492964:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789048487.492973:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789048487.492976:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789048487.492978:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789048487.497420:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097642752 00000100:00100000:2.0:1789048487.497434:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097642752 00000100:00100000:2.0:1789048487.497498:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 202 00000100:00100000:2.0:1789048487.497508:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2394:x1875953097642752:12345-192.168.202.16@tcp:400: 00000100:00100000:2.0:1789048487.497597:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2394:x1875953097642752:12345-192.168.202.16@tcp:400: Request processed in 90us (8359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048487.497606:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 202 00000020:00000080:1.0:1789048487.536284:0:10313:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed26083c0 20000000:00000080:1.0:1789048487.536315:0:10313:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff959c2f206400 uarg=0000000000000000 20000000:01000000:1.0:1789048487.536636:0:10313:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789048487.536639:0:10313:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789048487.536642:0:10313:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789048487.536647:0:10313:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789048487.536652:0:10313:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1789048487.536714:0:10313:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789048487.536716:0:10313:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789048487.537264:0:10314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1789048487.537991:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1789048487.538023:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1789048487.538038:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1789048487.538048:0:10313:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789048487.538050:0:10313:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789048487.538615:0:10315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1789048487.538752:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1789048487.538774:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1789048487.538790:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1789048487.538799:0:10313:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789048487.538801:0:10313:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789048487.539221:0:10316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1789048487.539912:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1789048487.539942:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1789048487.539956:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1789048487.539966:0:10313:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789048487.539968:0:10313:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789048487.540758:0:10317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1789048487.540948:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1789048487.540971:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1789048487.540985:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1789048487.540995:0:10313:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789048487.540997:0:10313:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789048487.541696:0:10318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1789048487.541844:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1789048487.541864:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1789048487.541880:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:1.0:1789048487.541893:0:10313:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789048487.541913:0:10313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff959c013d7200/0x133f221c08775e08 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.541938:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c00030000/0x133f221c08775ca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775c9c expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.541945:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c02836c00/0x133f221c08775ccd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775cc6 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.541952:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c00031600/0x133f221c08775d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775d05 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.541958:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c3ef3da00/0x133f221c08775d1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775d13 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.541964:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c013d6800/0x133f221c08775d28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775d21 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.541971:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c02836a00/0x133f221c08775d44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775d3d expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.541978:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c013d7a00/0x133f221c08775d67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775d60 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.541984:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c00031a00/0x133f221c08775d8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775d83 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.541991:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c420cd000/0x133f221c08775dad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775da6 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.542001:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c420cd200/0x133f221c08775dc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29588 expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.542019:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c3ef3d600/0x133f221c08775dc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2958f expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.542027:0:10313:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959c013d7200/0x133f221c08775e08 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.542093:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c3ef3d600/0x133f221c08775dc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2958f expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.542109:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c3ef3d600/0x133f221c08775dc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2958f expref: 9 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048487.542124:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb33b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111327104:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789048487.542233:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c420cd200/0x133f221c08775dc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29588 expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.542253:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c420cd200/0x133f221c08775dc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29588 expref: 9 pid: 6491 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048487.542263:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb30000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111327232:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789048487.542307:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c420cd000/0x133f221c08775dad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775da6 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.542316:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c420cd000/0x133f221c08775dad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775da6 expref: 23 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048487.542325:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb32a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111327360:0@lo:104: 00000100:00100000:1.0:1789048487.542391:0:10313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789048487.542490:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c00031a00/0x133f221c08775d8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775d83 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.542498:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c00031a00/0x133f221c08775d8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775d83 expref: 23 pid: 6490 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048487.542505:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb30700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111327488:0@lo:104: 00000100:00100000:1.0:1789048487.542527:0:10313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789048487.542550:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c013d7a00/0x133f221c08775d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775d60 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.542557:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c013d7a00/0x133f221c08775d67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775d60 expref: 23 pid: 6490 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048487.542565:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb30a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111327616:0@lo:104: 00000100:00100000:1.0:1789048487.542585:0:10313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048487.542614:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111327360 00000100:00100000:1.0:1789048487.542621:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111327360 00000100:00100000:1.0:1789048487.542654:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111327488 00000100:00100000:1.0:1789048487.542656:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111327488 00000100:00100000:1.0:1789048487.542667:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111327616 00000100:00100000:1.0:1789048487.542669:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111327616 00000100:00100000:1.0:1789048487.542681:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789048487.542689:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+5:10313:x1875953111327360:12345-0@lo:104: 00010000:00010000:1.0:1789048487.542703:0:8428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775da6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775dad expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.542749:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789048487.542756:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+5:10313:x1875953111327360:12345-0@lo:104: Request processed in 67us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048487.542774:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789048487.542792:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789048487.542798:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:10313:x1875953111327488:12345-0@lo:104: 00010000:00010000:1.0:1789048487.542806:0:8428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775d83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775d8a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.542842:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789048487.542847:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:10313:x1875953111327488:12345-0@lo:104: Request processed in 49us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048487.542853:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789048487.542865:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789048487.542871:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:10313:x1875953111327616:12345-0@lo:104: 00010000:00010000:1.0:1789048487.542878:0:8428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c08775d60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775d67 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.542912:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789048487.542917:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:10313:x1875953111327616:12345-0@lo:104: Request processed in 48us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048487.542923:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1789048487.542941:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789048487.542947:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775da6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775dad expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.542955:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c00030a00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048487.542958:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775da6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775dad expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.542978:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775da6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775dad expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048487.542986:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775da6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775dad expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048487.542992:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789048487.543021:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775da6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775dad expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543027:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048487.543044:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775da6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775dad expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543050:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c00030a00/0x133f221c08775da6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775dad expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543063:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789048487.543066:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775d83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775d8a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543071:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c00031800 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048487.543074:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775d83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775d8a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543080:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775d83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775d8a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048487.543086:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775d83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775d8a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048487.543098:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789048487.543112:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775d83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775d8a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543118:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048487.543123:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775d83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775d8a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543130:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775d83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775d8a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543140:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048487.543143:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c08775d60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775d67 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543148:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c800 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048487.543151:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c08775d60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775d67 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543158:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c08775d60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775d67 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048487.543164:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c08775d60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775d67 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048487.543169:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789048487.543193:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c08775d60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775d67 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543199:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048487.543217:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c08775d60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775d67 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543223:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c08775d60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775d67 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543232:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048487.543234:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048487.543236:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048487.543268:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c02836a00/0x133f221c08775d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775d3d expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543277:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c02836a00/0x133f221c08775d44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775d3d expref: 23 pid: 6492 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048487.543286:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111328128:0@lo:104: 00000100:00100000:1.0:1789048487.543313:0:10313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048487.543367:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789048487.543378:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111328128 00000100:00100000:1.0:1789048487.543382:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111328128 00000100:00100000:1.0:1789048487.543412:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789048487.543419:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ef41450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:10313:x1875953111328128:12345-0@lo:104: 00010000:00010000:1.0:1789048487.543427:0:8428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c08775d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775d44 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543457:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789048487.543462:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ef41450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:10313:x1875953111328128:12345-0@lo:104: Request processed in 44us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048487.543467:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1789048487.543502:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048487.543511:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c08775d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775d44 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543516:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c000 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048487.543519:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c08775d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775d44 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543526:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c08775d3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775d44 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048487.543532:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c08775d3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775d44 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048487.543538:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789048487.543553:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c08775d3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775d44 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543559:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048487.543565:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c08775d3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775d44 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543570:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c08775d3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775d44 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543578:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048487.543580:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048487.543582:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048487.543599:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c013d6800/0x133f221c08775d28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775d21 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543606:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c013d6800/0x133f221c08775d28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775d21 expref: 23 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048487.543621:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08109c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111328384:0@lo:104: 00000100:00100000:1.0:1789048487.543642:0:10313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048487.543662:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111328384 00000100:00100000:1.0:1789048487.543666:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111328384 00000100:00100000:1.0:1789048487.543682:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789048487.543687:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:10313:x1875953111328384:12345-0@lo:104: 00010000:00010000:1.0:1789048487.543695:0:8428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775d28 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543723:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789048487.543729:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:10313:x1875953111328384:12345-0@lo:104: Request processed in 41us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048487.543734:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1789048487.543746:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048487.543749:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775d28 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543755:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c00031200 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048487.543757:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775d28 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543764:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775d28 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048487.543770:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775d28 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048487.543775:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789048487.543793:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775d21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775d28 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543799:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048487.543803:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775d21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775d28 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543810:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c00031200/0x133f221c08775d21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775d28 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543820:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048487.543821:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048487.543823:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048487.543839:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c3ef3da00/0x133f221c08775d1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775d13 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543847:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c3ef3da00/0x133f221c08775d1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775d13 expref: 23 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048487.543855:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111328640:0@lo:104: 00000100:00100000:1.0:1789048487.543876:0:10313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048487.543894:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111328640 00000100:00100000:1.0:1789048487.543898:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111328640 00000100:00100000:1.0:1789048487.543915:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789048487.543920:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:10313:x1875953111328640:12345-0@lo:104: 00010000:00010000:1.0:1789048487.543927:0:8428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775d13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775d1a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543956:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789048487.543961:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:10313:x1875953111328640:12345-0@lo:104: Request processed in 42us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048487.543971:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1789048487.543985:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048487.543989:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775d13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775d1a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.543995:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837600 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048487.543999:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775d13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775d1a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.544006:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775d1a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048487.544012:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775d1a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048487.544017:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789048487.544030:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775d13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775d1a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.544035:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048487.544040:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775d13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775d1a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.544045:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775d13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775d1a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.544054:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048487.544055:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048487.544057:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048487.544073:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c00031600/0x133f221c08775d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775d05 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.544088:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c00031600/0x133f221c08775d0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775d05 expref: 23 pid: 6490 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048487.544097:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111328896:0@lo:104: 00000100:00100000:1.0:1789048487.544119:0:10313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048487.544139:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111328896 00000100:00100000:1.0:1789048487.544143:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111328896 00000100:00100000:1.0:1789048487.544158:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789048487.544164:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:10313:x1875953111328896:12345-0@lo:104: 00010000:00010000:1.0:1789048487.544171:0:8428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c08775d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775d0c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.544199:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789048487.544204:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:10313:x1875953111328896:12345-0@lo:104: Request processed in 41us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048487.544209:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1789048487.544221:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048487.544225:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c08775d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775d0c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.544231:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3ca00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048487.544233:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c08775d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775d0c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.544239:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c08775d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775d0c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048487.544260:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c08775d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775d0c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048487.544271:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789048487.544286:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c08775d05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775d0c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.544292:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048487.544297:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c08775d05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775d0c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.544303:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c08775d05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775d0c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.544313:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048487.544315:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048487.544317:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048487.544354:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c02836c00/0x133f221c08775ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775cc6 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.544363:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c02836c00/0x133f221c08775ccd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775cc6 expref: 23 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048487.544371:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111329152:0@lo:104: 00000100:00100000:1.0:1789048487.544395:0:10313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048487.544414:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111329152 00000100:00100000:1.0:1789048487.544417:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111329152 00010000:00010000:3.0:1789048487.545118:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048487.545134:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111328256:0@lo:103: 00000100:00100000:3.0:1789048487.545172:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048487.545221:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789048487.545227:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111328000:0@lo:103: 00000100:00100000:3.0:1789048487.545259:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048487.545277:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111329024:0@lo:103: 00000100:00100000:3.0:1789048487.545298:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048487.545323:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111328256 00000100:00100000:3.0:1789048487.545327:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111328256 00010000:00010000:3.0:1789048487.545372:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c02836a00/0x133f221c08775d44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775d3d expref: 24 pid: 6492 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048487.545387:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111328000 00000100:00100000:3.0:1789048487.545390:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111328000 00010000:00010000:3.0:1789048487.545410:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c013d7a00/0x133f221c08775d67 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775d60 expref: 25 pid: 6490 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048487.545420:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111329024 00000100:00100000:3.0:1789048487.545422:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111329024 00010000:00010000:3.0:1789048487.545432:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c00031600/0x133f221c08775d0c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775d05 expref: 26 pid: 6490 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048487.545443:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789048487.545449:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2aeccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+26:3623:x1875953111328256:12345-0@lo:103: 00010000:00010000:3.0:1789048487.545460:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048487.545464:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c02836a00/0x133f221c08775d44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775d3d expref: 26 pid: 6492 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.545487:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c02836a00/0x133f221c08775d44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775d3d expref: 26 pid: 6492 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.545504:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048487.545537:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2aeccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+26:3623:x1875953111328256:12345-0@lo:103: Request processed in 88us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048487.545544:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789048487.545586:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789048487.545592:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+25:3623:x1875953111328000:12345-0@lo:103: 00010000:00010000:3.0:1789048487.545600:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048487.545604:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c013d7a00/0x133f221c08775d67 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775d60 expref: 25 pid: 6490 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.545612:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c013d7a00/0x133f221c08775d67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775d60 expref: 25 pid: 6490 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.545623:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048487.545644:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+25:3623:x1875953111328000:12345-0@lo:103: Request processed in 52us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048487.545651:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789048487.545663:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789048487.545669:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3623:x1875953111329024:12345-0@lo:103: 00010000:00010000:3.0:1789048487.545675:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048487.545680:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c00031600/0x133f221c08775d0c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775d05 expref: 24 pid: 6490 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.545688:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c00031600/0x133f221c08775d0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775d05 expref: 24 pid: 6490 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.545704:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048487.545726:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3623:x1875953111329024:12345-0@lo:103: Request processed in 57us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048487.545732:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789048487.545766:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111328000:0@lo:103: 00000100:00100000:3.0:1789048487.545774:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111329024:0@lo:103: 00000100:00100000:3.0:1789048487.545781:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111328256:0@lo:103: 00000100:00100000:2.0:1789048487.546422:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111327872:0@lo:103: 00000100:00100000:2.0:1789048487.546455:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048487.546496:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111328768:0@lo:103: 00000100:00100000:2.0:1789048487.546514:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048487.546537:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789048487.546543:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111327744:0@lo:103: 00000100:00100000:2.0:1789048487.546562:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048487.546577:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111328512:0@lo:103: 00000100:00100000:2.0:1789048487.546595:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789048487.546622:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048487.546631:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111327872 00000100:00100000:2.0:1789048487.546636:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111327872 00010000:00010000:2.0:1789048487.546657:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c00031a00/0x133f221c08775d8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775d83 expref: 24 pid: 6490 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048487.546672:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111328768 00000100:00100000:2.0:1789048487.546682:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111328768 00010000:00010000:2.0:1789048487.546694:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c3ef3da00/0x133f221c08775d1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775d13 expref: 25 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048487.546707:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111327744 00000100:00100000:2.0:1789048487.546710:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111327744 00010000:00010000:2.0:1789048487.546720:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c420cd000/0x133f221c08775dad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775da6 expref: 26 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048487.546729:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111328512 00000100:00100000:2.0:1789048487.546731:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111328512 00010000:00010000:2.0:1789048487.546741:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c013d6800/0x133f221c08775d28 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775d21 expref: 27 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048487.546752:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789048487.546758:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+27:3621:x1875953111327872:12345-0@lo:103: 00010000:00010000:2.0:1789048487.546766:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048487.546770:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c00031a00/0x133f221c08775d8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775d83 expref: 27 pid: 6490 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048487.546778:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c00031a00/0x133f221c08775d8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775d83 expref: 27 pid: 6490 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048487.546791:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048487.546819:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+27:3621:x1875953111327872:12345-0@lo:103: Request processed in 62us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048487.546825:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789048487.546839:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789048487.546846:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+26:3621:x1875953111328768:12345-0@lo:103: 00010000:00010000:2.0:1789048487.546853:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048487.546862:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c3ef3da00/0x133f221c08775d1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775d13 expref: 26 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048487.546870:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c3ef3da00/0x133f221c08775d1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775d13 expref: 26 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048487.546879:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048487.546901:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+26:3621:x1875953111328768:12345-0@lo:103: Request processed in 57us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048487.546907:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789048487.546921:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789048487.546926:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+25:3621:x1875953111327744:12345-0@lo:103: 00010000:00010000:2.0:1789048487.546933:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048487.546937:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c420cd000/0x133f221c08775dad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775da6 expref: 25 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048487.546945:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c420cd000/0x133f221c08775dad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775da6 expref: 25 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048487.546953:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048487.546973:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+25:3621:x1875953111327744:12345-0@lo:103: Request processed in 46us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048487.546978:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789048487.546990:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789048487.546996:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3621:x1875953111328512:12345-0@lo:103: 00010000:00010000:2.0:1789048487.547003:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048487.547022:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c013d6800/0x133f221c08775d28 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775d21 expref: 24 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048487.547039:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c013d6800/0x133f221c08775d28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775d21 expref: 24 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048487.547048:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048487.547080:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3621:x1875953111328512:12345-0@lo:103: Request processed in 74us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048487.547087:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789048487.547117:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111327744:0@lo:103: 00000100:00100000:2.0:1789048487.547125:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111328512:0@lo:103: 00000100:00100000:2.0:1789048487.547131:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111327872:0@lo:103: 00000100:00100000:2.0:1789048487.547137:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111328768:0@lo:103: 00000100:00100000:2.0:1789048487.551151:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048487.551559:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097643392 00000100:00100000:3.0:1789048487.551569:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097643392 00010000:00010000:3.0:1789048487.551616:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c3ef3d600/0x133f221c08775dc9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2958f expref: 10 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048487.551654:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:3.0:1789048487.551664:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2aecd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2393:x1875953097643392:12345-192.168.202.16@tcp:103: 00010000:00010000:3.0:1789048487.551679:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048487.551685:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c3ef3d600/0x133f221c08775dc9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2958f expref: 10 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.551697:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c3ef3d600/0x133f221c08775dc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2958f expref: 10 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.551716:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048487.551766:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2aecd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2393:x1875953097643392:12345-192.168.202.16@tcp:103: Request processed in 104us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048487.551774:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 00010000:00010000:0.0:1789048487.552570:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c00030000/0x133f221c08775ca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775c9c expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048487.552593:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c00030000/0x133f221c08775ca3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775c9c expref: 23 pid: 6492 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048487.552608:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111329280:0@lo:104: 00000100:00100000:0.0:1789048487.552650:0:10313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048487.552684:0:10313:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b07b08a80 going to sleep for 11 seconds 00010000:00010000:0.0:1789048487.552709:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3d600/0x133f221c08775dc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2958f expref: 9 pid: 6490 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048487.552722:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb33b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111327104:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789048487.552735:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb30000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111327232:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048487.552745:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c420cd000/0x133f221c08775dad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775da6 expref: 23 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048487.552755:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb32a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111327360:0@lo:104: 00010000:00010000:0.0:1789048487.552764:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c00031a00/0x133f221c08775d8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775d83 expref: 22 pid: 6490 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048487.552791:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb30700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111327488:0@lo:104: 00010000:00010000:0.0:1789048487.552804:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c013d7a00/0x133f221c08775d67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775d60 expref: 21 pid: 6490 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048487.552813:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb30a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111327616:0@lo:104: 00010000:00010000:0.0:1789048487.552823:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c02836a00/0x133f221c08775d44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775d3d expref: 20 pid: 6492 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048487.552831:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111328128:0@lo:104: 00010000:00010000:0.0:1789048487.552840:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c013d6800/0x133f221c08775d28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775d21 expref: 19 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048487.552848:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08109c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111328384:0@lo:104: 00010000:00010000:0.0:1789048487.552858:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3da00/0x133f221c08775d1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775d13 expref: 18 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048487.552865:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111328640:0@lo:104: 00010000:00010000:0.0:1789048487.552874:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c00031600/0x133f221c08775d0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775d05 expref: 17 pid: 6490 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048487.552882:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111328896:0@lo:104: 00000100:00100000:3.0:1789048487.552932:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111329280 00000100:00100000:3.0:1789048487.552943:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111329280 00000100:00100000:3.0:1789048487.552982:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789048487.552990:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:10313:x1875953111329280:12345-0@lo:104: 00010000:00010000:3.0:1789048487.553000:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775c9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775ca3 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.553055:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789048487.553060:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:10313:x1875953111329280:12345-0@lo:104: Request processed in 73us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048487.553066:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789048487.553232:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111329280:0@lo:104: 00010000:00010000:2.0:1789048487.553470:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048487.553476:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775c9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775ca3 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048487.553483:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836e00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048487.553488:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775c9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775ca3 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048487.553496:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775c9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775ca3 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048487.553503:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775c9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775ca3 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048487.553516:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789048487.553553:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775c9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775ca3 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048487.553559:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789048487.553670:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111329408:0@lo:103: 00000100:00100000:3.0:1789048487.553703:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048487.553742:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111329408 00000100:00100000:3.0:1789048487.553758:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111329408 00010000:00010000:3.0:1789048487.553775:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c00030000/0x133f221c08775ca3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775c9c expref: 17 pid: 6492 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048487.553796:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789048487.553803:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:3623:x1875953111329408:12345-0@lo:103: 00010000:00010000:3.0:1789048487.553812:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048487.553817:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c00030000/0x133f221c08775ca3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775c9c expref: 17 pid: 6492 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.553827:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c00030000/0x133f221c08775ca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775c9c expref: 17 pid: 6492 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.553839:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c00030000/0x133f221c08775ca3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775c9c expref: 17 pid: 6492 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.553862:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048487.553892:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:3623:x1875953111329408:12345-0@lo:103: Request processed in 90us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048487.553898:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789048487.553924:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111329408:0@lo:103: 00010000:00010000:2.0:1789048487.554351:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775c9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775ca3 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048487.554360:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c02836e00/0x133f221c08775c9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775ca3 expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048487.554373:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048487.554375:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048487.554377:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048487.554725:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789048487.554734:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:10313:x1875953111329152:12345-0@lo:104: 00010000:00010000:1.0:1789048487.554746:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775cc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775ccd expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.554802:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789048487.554807:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:10313:x1875953111329152:12345-0@lo:104: Request processed in 76us (10411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048487.554813:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1789048487.554827:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048487.554832:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775cc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775ccd expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.554838:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c013d7800 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048487.554842:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775cc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775ccd expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.554850:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775cc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775ccd expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048487.554856:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775cc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775ccd expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048487.554862:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789048487.554884:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775cc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775ccd expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.554889:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048487.554905:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775cc6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775ccd expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.554911:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775cc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775ccd expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.554933:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048487.554935:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048487.554936:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048487.554948:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111329536:0@lo:103: 00000100:00100000:1.0:1789048487.554976:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048487.555007:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111329536 00000100:00100000:1.0:1789048487.555011:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111329536 00010000:00010000:1.0:1789048487.555027:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c02836c00/0x133f221c08775ccd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775cc6 expref: 16 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048487.555047:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789048487.555053:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:3620:x1875953111329536:12345-0@lo:103: 00010000:00010000:1.0:1789048487.555061:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048487.555065:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c02836c00/0x133f221c08775ccd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775cc6 expref: 16 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048487.555988:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1875953111329152:0@lo:104: 00010000:00010000:2.0:1789048487.556040:0:10313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff959c013d7200/0x133f221c08775e08 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.556253:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c02836c00/0x133f221c08775ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775cc6 expref: 16 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.556270:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c02836c00/0x133f221c08775ccd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775cc6 expref: 16 pid: 6491 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048487.556283:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048487.556618:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:3620:x1875953111329536:12345-0@lo:103: Request processed in 1563us (1639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048487.556627:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789048487.556764:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111329536:0@lo:103: 00000100:00100000:2.0:1789048487.564280:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048487.564735:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097643520 00000100:00100000:3.0:1789048487.564745:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097643520 00010000:00010000:3.0:1789048487.564783:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c420cd200/0x133f221c08775dc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29588 expref: 9 pid: 6491 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048487.564823:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:3.0:1789048487.564833:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+9:2393:x1875953097643520:12345-192.168.202.16@tcp:103: 00010000:00010000:3.0:1789048487.564849:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048487.564855:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c420cd200/0x133f221c08775dc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29588 expref: 9 pid: 6491 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.564867:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c420cd200/0x133f221c08775dc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29588 expref: 9 pid: 6491 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.564886:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c420cd200/0x133f221c08775dc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29588 expref: 9 pid: 6491 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.564914:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959c013d7200/0x133f221c08775e08 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.564923:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c013d7200/0x133f221c08775e08 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.564953:0:6482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c013d7200/0x133f221c08775e08 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.564960:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c013d7200/0x133f221c08775e08 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.564966:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff959c013d7200/0x133f221c08775e08 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.564973:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff959c013d7200/0x133f221c08775e08 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.564979:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c013d7200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048487.564984:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff959c013d7200/0x133f221c08775e08 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.564992:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff959c013d7200/0x133f221c08775e08 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.565008:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff959c013d7200/0x133f221c08775e08 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048487.565020:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048487.565096:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+8:2393:x1875953097643520:12345-192.168.202.16@tcp:103: Request processed in 262us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048487.565103:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 34 00010000:00010000:2.0:1789048487.565643:0:10313:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff959c013d7200/0x133f221c08775e08 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048487.565654:0:10313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff959c013d7200/0x133f221c08775e08 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048487.565660:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c013d7200/0x133f221c08775e08 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048487.901685:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789048488.607465:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789048488.607473:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959b06952000 from 48 10000000:01000000:3.0:1789048488.607478:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789048488.607529:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d400/0x133f221c08775e0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048488.607555:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d400/0x133f221c08775e0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048488.607568:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d400/0x133f221c08775e0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048488.607591:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111329664:0@lo:101: 00000100:00100000:3.0:1789048488.607673:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048488.607741:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3d3ef780 going to sleep for 11 seconds 00000100:00100000:1.0:1789048488.607772:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111329664 00000100:00100000:1.0:1789048488.607779:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111329664 00000100:00100000:1.0:1789048488.607841:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789048488.607850:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+15:6494:x1875953111329664:12345-0@lo:101: 00010000:00010000:1.0:1789048488.607865:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048488.607878:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c013d6600/0x133f221c08775e16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775e0f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.607903:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c013d6600/0x133f221c08775e16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775e0f expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.607915:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c013d6600/0x133f221c08775e16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775e0f expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.607924:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c013d6600, rc 0) 00000100:00100000:1.0:1789048488.608315:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:6494:x1875953111329664:12345-0@lo:101: Request processed in 464us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048488.608321:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789048488.611447:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111329664:0@lo:101: 00010000:00010000:3.0:1789048488.611482:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d400/0x133f221c08775e0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048488.611565:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d400/0x133f221c08775e0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775e16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048488.611727:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111329792:0@lo:501: 00000100:00100000:3.0:1789048488.611787:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048488.611908:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3d3ef780 going to sleep for 11 seconds 00000100:00100000:2.0:1789048488.614312:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111329792 00000100:00100000:2.0:1789048488.614326:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111329792 00000100:00100000:2.0:1789048488.614570:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789048488.614582:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:6494:x1875953111329792:12345-0@lo:501: 00000100:00100000:2.0:1789048488.614783:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:6494:x1875953111329792:12345-0@lo:501: Request processed in 203us (2995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048488.614791:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789048488.614888:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111329792:0@lo:501: 00000100:00100000:3.0:1789048488.614936:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111329920:0@lo:503: 00000100:00100000:3.0:1789048488.614990:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048488.620018:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3d3ef780 going to sleep for 11 seconds 00000100:00100000:1.0:1789048488.620396:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111329920 00000100:00100000:1.0:1789048488.620406:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111329920 00000100:00100000:1.0:1789048488.620459:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789048488.620471:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:6494:x1875953111329920:12345-0@lo:503: 00000100:00100000:1.0:1789048488.620841:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:6494:x1875953111329920:12345-0@lo:503: Request processed in 372us (5850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048488.620849:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789048488.620979:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111329920:0@lo:503: 00000100:00100000:3.0:1789048488.622127:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10330:1875953111330048:0@lo:502: 00000100:00100000:3.0:1789048488.622225:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048488.622303:0:10330:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3d3ef900 going to sleep for 11 seconds 00000100:00100000:1.0:1789048488.622632:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111330048 00000100:00100000:1.0:1789048488.622640:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111330048 00000100:00100000:1.0:1789048488.622693:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789048488.622702:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:10330:x1875953111330048:12345-0@lo:502: 00000100:00100000:1.0:1789048488.622841:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:10330:x1875953111330048:12345-0@lo:502: Request processed in 140us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048488.622856:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789048488.623063:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10330:1875953111330048:0@lo:502: 00000100:00100000:3.0:1789048488.623109:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10330:1875953111330176:0@lo:502: 00000100:00100000:3.0:1789048488.623152:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048488.623177:0:10330:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3e87e480 going to sleep for 11 seconds 00000100:00100000:0.0:1789048488.623362:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111330176 00000100:00100000:0.0:1789048488.623367:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111330176 00000100:00100000:0.0:1789048488.623417:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789048488.623423:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:10330:x1875953111330176:12345-0@lo:502: 00000100:00100000:0.0:1789048488.623751:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:10330:x1875953111330176:12345-0@lo:502: Request processed in 326us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048488.623764:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789048488.625835:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10330:1875953111330176:0@lo:502: 00000040:00080000:3.0:1789048488.625886:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789048488.629313:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789048488.629706:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789048488.629719:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d400/0x133f221c08775e0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.629732:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d400/0x133f221c08775e0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048488.629742:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789048488.629744:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1789048488.629747:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789048488.629785:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775e1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.629793:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775e1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.629803:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775e1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048488.629825:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111330304:0@lo:101: 00000100:00100000:1.0:1789048488.629898:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048488.630017:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b07b08c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789048488.632549:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111330304 00000100:00100000:2.0:1789048488.632564:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111330304 00000100:00100000:0.0:1789048488.632766:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789048488.632779:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+16:6494:x1875953111330304:12345-0@lo:101: 00010000:00010000:0.0:1789048488.632795:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048488.632813:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c420cda00/0x133f221c08775e24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775e1d expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048488.632840:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c420cda00/0x133f221c08775e24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775e1d expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048488.632850:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c420cda00/0x133f221c08775e24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775e1d expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048488.632859:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c420cda00, rc 0) 00000100:00100000:0.0:1789048488.632943:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111330304:12345-0@lo:101: Request processed in 167us (3046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048488.632950:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789048488.633576:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111330304:0@lo:101: 00010000:00010000:1.0:1789048488.633602:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775e1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.633685:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775e1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775e24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048488.633780:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111330432:0@lo:501: 00000100:00100000:1.0:1789048488.633819:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048488.633859:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b07b08c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789048488.633921:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111330432 00000100:00100000:2.0:1789048488.633927:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111330432 00000100:00100000:2.0:1789048488.633963:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789048488.633971:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111330432:12345-0@lo:501: 00000100:00100000:2.0:1789048488.637826:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111330432:12345-0@lo:501: Request processed in 3845us (3996us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048488.637840:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789048488.638520:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111330432:0@lo:501: 00000100:00100000:3.0:1789048488.638578:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111330560:0@lo:503: 00000100:00100000:3.0:1789048488.638772:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048488.638801:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3d3ef900 going to sleep for 11 seconds 00000100:00100000:2.0:1789048488.639502:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111330560 00000100:00100000:2.0:1789048488.639510:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111330560 00000100:00100000:2.0:1789048488.639556:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789048488.639564:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111330560:12345-0@lo:503: 00000100:00100000:2.0:1789048488.639743:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111330560:12345-0@lo:503: Request processed in 179us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048488.639750:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789048488.640364:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111330560:0@lo:503: 00000100:00100000:0.0:1789048488.640842:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10331:1875953111330688:0@lo:502: 00000100:00100000:0.0:1789048488.640886:0:10331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048488.640920:0:10331:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f480 going to sleep for 11 seconds 00000100:00100000:2.0:1789048488.641030:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111330688 00000100:00100000:2.0:1789048488.641035:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111330688 00000100:00100000:2.0:1789048488.641068:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789048488.641075:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:10331:x1875953111330688:12345-0@lo:502: 00000100:00100000:2.0:1789048488.641167:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:10331:x1875953111330688:12345-0@lo:502: Request processed in 92us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048488.641179:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789048488.641269:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10331:1875953111330688:0@lo:502: 00000020:01000000:1.0:1789048488.641291:0:10331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048488.641299:0:10331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048488.641301:0:10331:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789048488.641316:0:10331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789048488.641352:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10331:1875953111330816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048488.641391:0:10331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048488.641408:0:10331:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b07b08d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789048488.641626:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111330816 00000100:00100000:0.0:1789048488.641630:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111330816 00000100:00100000:0.0:1789048488.641663:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789048488.641670:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:10331:x1875953111330816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048488.641738:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:10331:x1875953111330816:12345-0@lo:502:llog_process_th.0 Request processed in 68us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048488.641749:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789048488.641873:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10331:1875953111330816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789048488.641888:0:10331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048488.641891:0:10331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048488.641892:0:10331:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789048488.641895:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1789048488.642954:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789048488.642985:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789048488.642996:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775e1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048488.643007:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775e1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048488.643017:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789048488.643020:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959c41779800 from 48 10000000:01000000:0.0:1789048488.643022:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789048488.643053:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c420cd000/0x133f221c08775e2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048488.643061:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c420cd000/0x133f221c08775e2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048488.643071:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c420cd000/0x133f221c08775e2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048488.643090:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111330944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789048488.643145:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048488.643181:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789048488.643248:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111330944 00000100:00100000:2.0:1789048488.643254:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111330944 00000100:00100000:2.0:1789048488.643296:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789048488.643305:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+17:6494:x1875953111330944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048488.643316:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048488.643329:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c02836e00/0x133f221c08775e32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775e2b expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048488.643398:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c02836e00/0x133f221c08775e32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775e2b expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048488.643409:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c02836e00/0x133f221c08775e32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775e2b expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048488.643418:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02836e00, rc 0) 00000100:00100000:2.0:1789048488.643453:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111330944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048488.643459:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789048488.643780:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111330944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789048488.643795:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c420cd000/0x133f221c08775e2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e32 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048488.643820:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c420cd000/0x133f221c08775e2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775e32 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048488.643877:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111331072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048488.643905:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048488.643933:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789048488.643992:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111331072 00000100:00100000:2.0:1789048488.643996:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111331072 00000100:00100000:2.0:1789048488.644027:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789048488.644033:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111331072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048488.644146:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111331072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048488.644153:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789048488.644262:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111331072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048488.644290:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111331200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789048488.644327:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048488.644368:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789048488.644514:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111331200 00000100:00100000:1.0:1789048488.644518:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111331200 00000100:00100000:1.0:1789048488.644549:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789048488.644555:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111331200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048488.644645:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111331200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048488.644651:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789048488.644793:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111331200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789048488.645734:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10332:1875953111331328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048488.645779:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048488.645814:0:10332:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789048488.645867:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111331328 00000100:00100000:1.0:1789048488.645872:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111331328 00000100:00100000:1.0:1789048488.645909:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789048488.645924:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:10332:x1875953111331328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048488.646017:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:10332:x1875953111331328:12345-0@lo:502:llog_process_th.0 Request processed in 94us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048488.646024:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789048488.646114:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10332:1875953111331328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789048488.646175:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10332:1875953111331456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789048488.646211:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048488.646249:0:10332:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c02c49540 going to sleep for 11 seconds 00000100:00100000:1.0:1789048488.646510:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111331456 00000100:00100000:1.0:1789048488.646514:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111331456 00000100:00100000:1.0:1789048488.646548:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789048488.646555:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:10332:x1875953111331456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048488.646782:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:10332:x1875953111331456:12345-0@lo:502:llog_process_th.0 Request processed in 227us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048488.646789:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789048488.647841:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10332:1875953111331456:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789048488.647878:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789048488.647991:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789048488.648013:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789048488.648024:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c420cd000/0x133f221c08775e2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e32 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048488.648041:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c420cd000/0x133f221c08775e2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e32 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048488.648051:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789048488.648053:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789048488.648056:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789048488.648100:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c420cd200/0x133f221c08775e39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048488.648108:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c420cd200/0x133f221c08775e39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048488.648116:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c420cd200/0x133f221c08775e39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048488.648144:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111331584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789048488.648193:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048488.648251:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41497900 going to sleep for 11 seconds 00000100:00100000:1.0:1789048488.648265:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111331584 00000100:00100000:1.0:1789048488.648270:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111331584 00000100:00100000:1.0:1789048488.648316:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789048488.648324:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+18:6494:x1875953111331584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048488.648385:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048488.648398:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c013d7200/0x133f221c08775e40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775e39 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.648421:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c013d7200/0x133f221c08775e40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775e39 expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.648432:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c013d7200/0x133f221c08775e40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775e39 expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.648441:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c013d7200, rc 0) 00000100:00100000:1.0:1789048488.648485:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:6494:x1875953111331584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048488.648498:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789048488.648699:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111331584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789048488.648711:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c420cd200/0x133f221c08775e39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e40 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048488.648720:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c420cd200/0x133f221c08775e39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775e40 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048488.648775:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111331712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048488.648802:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048488.648834:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41497900 going to sleep for 11 seconds 00000100:00100000:2.0:1789048488.648894:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111331712 00000100:00100000:2.0:1789048488.648899:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111331712 00000100:00100000:2.0:1789048488.648936:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789048488.648944:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:6494:x1875953111331712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048488.649070:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:6494:x1875953111331712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048488.649077:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789048488.649741:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111331712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048488.649778:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111331840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789048488.649820:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048488.649851:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41497900 going to sleep for 11 seconds 00000100:00100000:2.0:1789048488.650252:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111331840 00000100:00100000:2.0:1789048488.650258:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111331840 00000100:00100000:2.0:1789048488.650301:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789048488.650309:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:6494:x1875953111331840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048488.650754:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:6494:x1875953111331840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 444us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048488.650761:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789048488.651208:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111331840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048488.652794:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10333:1875953111331968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789048488.652863:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048488.652936:0:10333:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb69840 going to sleep for 11 seconds 00000100:00100000:1.0:1789048488.655284:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111331968 00000100:00100000:1.0:1789048488.655299:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111331968 00000100:00100000:1.0:1789048488.655418:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789048488.655429:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:10333:x1875953111331968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048488.655770:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:10333:x1875953111331968:12345-0@lo:502:llog_process_th.0 Request processed in 342us (2906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048488.655778:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789048488.655857:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10333:1875953111331968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789048488.655892:0:10333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789048488.655900:0:10333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048488.655903:0:10333:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789048488.655908:0:10333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789048488.655943:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10333:1875953111332096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789048488.655994:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048488.656066:0:10333:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb69840 going to sleep for 11 seconds 00000100:00100000:1.0:1789048488.656110:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111332096 00000100:00100000:1.0:1789048488.656115:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111332096 00000100:00100000:1.0:1789048488.656247:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789048488.656256:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:10333:x1875953111332096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048488.656529:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:10333:x1875953111332096:12345-0@lo:502:llog_process_th.0 Request processed in 274us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048488.656536:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789048488.656588:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10333:1875953111332096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789048488.656609:0:10333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789048488.656613:0:10333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048488.656615:0:10333:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789048488.656619:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1789048488.656876:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789048488.656907:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789048488.656918:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c420cd200/0x133f221c08775e39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e40 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.656931:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c420cd200/0x133f221c08775e39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e40 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048488.656942:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789048488.656945:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959c414c7000 from 48 10000000:01000000:1.0:1789048488.656947:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789048488.656973:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c013d6800/0x133f221c08775e47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.656988:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c013d6800/0x133f221c08775e47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.656999:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c013d6800/0x133f221c08775e47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048488.657016:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111332224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789048488.657048:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048488.657107:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b07b08780 going to sleep for 11 seconds 00000100:00100000:2.0:1789048488.657252:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111332224 00000100:00100000:2.0:1789048488.657257:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111332224 00000100:00100000:2.0:1789048488.657368:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789048488.657376:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:6494:x1875953111332224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048488.657387:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048488.657400:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c02836800/0x133f221c08775e4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775e47 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048488.657421:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c02836800/0x133f221c08775e4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775e47 expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048488.657432:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c02836800/0x133f221c08775e4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775e47 expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048488.657440:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02836800, rc 0) 00000100:00100000:2.0:1789048488.657474:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:6494:x1875953111332224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048488.657480:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789048488.657547:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111332224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048488.657562:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c013d6800/0x133f221c08775e47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e4e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.657570:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c013d6800/0x133f221c08775e47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775e4e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048488.657619:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111332352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048488.657659:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048488.670416:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b07b08780 going to sleep for 11 seconds 00000100:00100000:0.0:1789048488.670550:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111332352 00000100:00100000:0.0:1789048488.670561:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111332352 00000100:00100000:0.0:1789048488.670618:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789048488.670628:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:6494:x1875953111332352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048488.670810:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:6494:x1875953111332352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (13149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048488.670817:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789048488.671057:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111332352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048488.671109:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111332480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048488.671161:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048488.671190:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b07b08780 going to sleep for 11 seconds 00000100:00100000:2.0:1789048488.671256:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111332480 00000100:00100000:2.0:1789048488.671262:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111332480 00000100:00100000:2.0:1789048488.671288:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789048488.671295:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:6494:x1875953111332480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048488.671407:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:6494:x1875953111332480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048488.671414:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789048488.671497:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111332480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048488.673648:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10334:1875953111332608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048488.673727:0:10334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048488.673770:0:10334:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b07b08540 going to sleep for 11 seconds 00000100:00100000:2.0:1789048488.673930:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111332608 00000100:00100000:2.0:1789048488.673938:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111332608 00000100:00100000:2.0:1789048488.673977:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789048488.673987:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:10334:x1875953111332608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789048488.674108:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:10334:x1875953111332608:12345-0@lo:502:llog_process_th.0 Request processed in 121us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048488.674116:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789048488.675876:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10334:1875953111332608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048488.675965:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10334:1875953111332736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048488.676028:0:10334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048488.676072:0:10334:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41497600 going to sleep for 11 seconds 00000100:00100000:1.0:1789048488.676183:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111332736 00000100:00100000:1.0:1789048488.676190:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111332736 00000100:00100000:1.0:1789048488.676246:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789048488.676254:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:10334:x1875953111332736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048488.676397:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:10334:x1875953111332736:12345-0@lo:502:llog_process_th.0 Request processed in 143us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048488.676406:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789048488.678603:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10334:1875953111332736:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789048488.678673:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789048488.678860:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789048488.678883:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789048488.678894:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c013d6800/0x133f221c08775e47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e4e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048488.678906:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c013d6800/0x133f221c08775e47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e4e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048488.678917:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789048488.678919:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1789048488.678922:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789048488.678963:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02836200/0x133f221c08775e55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048488.678972:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c02836200/0x133f221c08775e55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048488.678982:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c02836200/0x133f221c08775e55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048488.679015:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111332864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789048488.679077:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048488.679114:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb69480 going to sleep for 11 seconds 00000100:00100000:1.0:1789048488.679212:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111332864 00000100:00100000:1.0:1789048488.679220:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111332864 00000100:00100000:1.0:1789048488.679267:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789048488.679276:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:6494:x1875953111332864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048488.679289:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048488.679301:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c013d7a00/0x133f221c08775e5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775e55 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.679324:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c013d7a00/0x133f221c08775e5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775e55 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.679356:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c013d7a00/0x133f221c08775e5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775e55 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.679364:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c013d7a00, rc 0) 00000100:00100000:1.0:1789048488.679402:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111332864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048488.679409:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789048488.679573:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111332864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048488.679586:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c02836200/0x133f221c08775e55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e5c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048488.679594:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c02836200/0x133f221c08775e55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775e5c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048488.679659:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111332992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048488.679686:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048488.679710:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb69480 going to sleep for 11 seconds 00000100:00100000:0.0:1789048488.679802:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111332992 00000100:00100000:0.0:1789048488.679806:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111332992 00000100:00100000:0.0:1789048488.679842:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789048488.679850:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111332992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048488.679962:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111332992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048488.679970:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789048488.680058:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111332992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048488.680084:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111333120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048488.680124:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048488.680144:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb69480 going to sleep for 11 seconds 00000100:00100000:0.0:1789048488.680824:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111333120 00000100:00100000:0.0:1789048488.680830:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111333120 00000100:00100000:0.0:1789048488.680868:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789048488.680875:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111333120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789048488.680988:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111333120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048488.681001:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789048488.681077:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111333120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048488.681698:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10335:1875953111333248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048488.681749:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048488.681773:0:10335:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c39495cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048488.681814:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111333248 00000100:00100000:2.0:1789048488.681819:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111333248 00000100:00100000:2.0:1789048488.681855:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789048488.681863:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:10335:x1875953111333248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789048488.681955:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:10335:x1875953111333248:12345-0@lo:502:llog_process_th.0 Request processed in 92us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048488.681971:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789048488.682107:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10335:1875953111333248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789048488.682132:0:10335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048488.682140:0:10335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048488.682142:0:10335:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789048488.682147:0:10335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789048488.682167:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10335:1875953111333376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048488.682201:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048488.682222:0:10335:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11544b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789048488.682270:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111333376 00000100:00100000:0.0:1789048488.682276:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111333376 00000100:00100000:0.0:1789048488.682307:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789048488.682314:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:10335:x1875953111333376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048488.682422:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:10335:x1875953111333376:12345-0@lo:502:llog_process_th.0 Request processed in 108us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048488.682429:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789048488.684589:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10335:1875953111333376:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789048488.684649:0:10335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048488.684659:0:10335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048488.684662:0:10335:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789048488.684667:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1789048488.685324:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1789048488.685371:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789048488.685383:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02836200/0x133f221c08775e55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e5c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048488.685396:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c02836200/0x133f221c08775e55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e5c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048488.685406:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789048488.685409:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959c335d0800 from 48 10000000:01000000:2.0:1789048488.685412:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789048488.685453:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02836a00/0x133f221c08775e63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048488.685462:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c02836a00/0x133f221c08775e63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048488.685472:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c02836a00/0x133f221c08775e63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048488.685494:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111333504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789048488.685573:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048488.685604:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb696c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048488.686820:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111333504 00000100:00100000:0.0:1789048488.686832:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111333504 00000100:00100000:0.0:1789048488.686891:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789048488.686900:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111333504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789048488.686916:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048488.686931:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c420cca00/0x133f221c08775e6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775e63 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048488.686959:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c420cca00/0x133f221c08775e6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775e63 expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048488.686971:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c420cca00/0x133f221c08775e6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775e63 expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048488.686979:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c420cca00, rc 0) 00000100:00100000:0.0:1789048488.687040:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111333504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048488.687047:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789048488.687398:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111333504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048488.687415:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c02836a00/0x133f221c08775e63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e6a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048488.687443:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c02836a00/0x133f221c08775e63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775e6a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048488.687510:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111333632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048488.687543:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048488.687565:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb696c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048488.687617:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111333632 00000100:00100000:1.0:1789048488.687623:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111333632 00000100:00100000:1.0:1789048488.687666:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789048488.687674:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111333632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048488.687792:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111333632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048488.687799:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789048488.688031:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111333632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048488.688050:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111333760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048488.688086:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048488.688110:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb696c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048488.688168:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111333760 00000100:00100000:0.0:1789048488.688178:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111333760 00000100:00100000:0.0:1789048488.688203:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789048488.688207:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111333760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789048488.688292:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111333760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048488.688298:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789048488.688388:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111333760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048488.690653:0:10336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10336:1875953111333888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789048488.690740:0:10336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048488.691485:0:10336:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb69c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789048488.696450:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111333888 00000100:00100000:0.0:1789048488.696466:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111333888 00000100:00100000:0.0:1789048488.696528:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789048488.696539:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:10336:x1875953111333888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048488.696726:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:10336:x1875953111333888:12345-0@lo:502:llog_process_th.0 Request processed in 189us (5986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048488.696734:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789048488.696902:0:10336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10336:1875953111333888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048488.696973:0:10336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb56a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10336:1875953111334016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048488.697013:0:10336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048488.697043:0:10336:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3e87e480 going to sleep for 11 seconds 00000100:00100000:1.0:1789048488.697168:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111334016 00000100:00100000:1.0:1789048488.697173:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111334016 00000100:00100000:1.0:1789048488.697206:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789048488.697214:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:10336:x1875953111334016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048488.697293:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:10336:x1875953111334016:12345-0@lo:502:llog_process_th.0 Request processed in 80us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048488.697306:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789048488.697494:0:10336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb56a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10336:1875953111334016:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789048488.697518:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789048488.697728:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789048488.697749:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789048488.697762:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02836a00/0x133f221c08775e63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e6a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048488.697774:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c02836a00/0x133f221c08775e63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e6a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048488.697785:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789048488.697788:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1789048488.697791:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789048488.697825:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775e71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048488.697834:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775e71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048488.697845:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775e71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048488.697860:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111334144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789048488.697897:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048488.697932:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c02c49c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789048488.698063:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111334144 00000100:00100000:1.0:1789048488.698068:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111334144 00000100:00100000:1.0:1789048488.698097:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789048488.698105:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111334144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048488.698116:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048488.698129:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c013d7400/0x133f221c08775e78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775e71 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.698163:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c013d7400/0x133f221c08775e78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775e71 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.698174:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c013d7400/0x133f221c08775e78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775e71 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.698183:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c013d7400, rc 0) 00000100:00100000:1.0:1789048488.698221:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111334144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048488.698227:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789048488.699533:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111334144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048488.699561:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775e71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e78 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048488.699590:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775e71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775e78 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048488.699693:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb56a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111334272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048488.699744:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048488.699773:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb69c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789048488.702321:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111334272 00000100:00100000:1.0:1789048488.702348:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111334272 00000100:00100000:1.0:1789048488.702410:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789048488.702420:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111334272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048488.702589:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111334272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (2843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048488.702597:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789048488.702725:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb56a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111334272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048488.702778:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb56a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111334400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789048488.702833:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048488.702873:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb69c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789048488.703489:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111334400 00000100:00100000:1.0:1789048488.703514:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111334400 00000100:00100000:1.0:1789048488.703556:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789048488.703565:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111334400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048488.703684:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111334400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048488.703691:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789048488.703949:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb56a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111334400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048488.711501:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10337:1875953111334528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789048488.711598:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048488.711651:0:10337:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048488.711787:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111334528 00000100:00100000:0.0:1789048488.711795:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111334528 00000100:00100000:0.0:1789048488.711850:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789048488.711861:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:10337:x1875953111334528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048488.712003:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:10337:x1875953111334528:12345-0@lo:502:llog_process_th.0 Request processed in 142us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048488.712011:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789048488.712028:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10337:1875953111334528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789048488.712056:0:10337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048488.712075:0:10337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048488.712078:0:10337:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789048488.712083:0:10337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789048488.712107:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10337:1875953111334656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048488.712156:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048488.712179:0:10337:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c034fd840 going to sleep for 11 seconds 00000100:00100000:3.0:1789048488.712239:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111334656 00000100:00100000:3.0:1789048488.712244:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111334656 00000100:00100000:3.0:1789048488.712314:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789048488.712322:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:10337:x1875953111334656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048488.712434:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:10337:x1875953111334656:12345-0@lo:502:llog_process_th.0 Request processed in 112us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048488.712441:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789048488.712467:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10337:1875953111334656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789048488.712487:0:10337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789048488.712491:0:10337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048488.712493:0:10337:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789048488.712497:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789048488.712662:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1789048488.712685:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789048488.712695:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775e71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e78 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048488.712718:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775e71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e78 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048488.712728:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789048488.712731:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff959c394bb380 from 1 10000000:01000000:0.0:1789048488.712734:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789048488.712759:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c420cc200/0x133f221c08775e7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048488.712766:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c420cc200/0x133f221c08775e7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048488.712775:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c420cc200/0x133f221c08775e7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048488.712789:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111334784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789048488.712819:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048488.717931:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41497540 going to sleep for 11 seconds 00000100:00100000:1.0:1789048488.720490:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111334784 00000100:00100000:1.0:1789048488.721369:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111334784 00000100:00100000:1.0:1789048488.721569:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789048488.721582:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111334784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048488.721600:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048488.721631:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c013d6200/0x133f221c08775e86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775e7f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.721660:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c013d6200/0x133f221c08775e86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775e7f expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.721673:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c013d6200/0x133f221c08775e86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775e7f expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048488.721698:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c013d6200, rc 0) 00000100:00100000:1.0:1789048488.721778:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:6494:x1875953111334784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (8957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048488.721784:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789048488.723732:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111334784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789048488.723761:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c420cc200/0x133f221c08775e7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e86 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048488.723775:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c420cc200/0x133f221c08775e7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775e86 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048488.723867:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111334912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048488.723918:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048488.723977:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41497540 going to sleep for 11 seconds 00000100:00100000:1.0:1789048488.724156:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111334912 00000100:00100000:1.0:1789048488.724163:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111334912 00000100:00100000:1.0:1789048488.724720:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789048488.724732:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:6494:x1875953111334912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048488.724832:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:6494:x1875953111334912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (913us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789048488.724840:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789048488.724853:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111334912:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789048488.724885:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789048488.724893:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c420cc200/0x133f221c08775e7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e86 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048488.724903:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c420cc200/0x133f221c08775e7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e86 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048488.926893:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048489.418565:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048489.419046:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097643648 00000100:00100000:1.0:1789048489.419058:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097643648 00000100:00100000:1.0:1789048489.419120:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 245 00000100:00100000:1.0:1789048489.419131:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+8:6169:x1875953097643648:12345-192.168.202.16@tcp:101: 00010000:00010000:1.0:1789048489.419148:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048489.419166:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c013d7600/0x133f221c08775e8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b295ff expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048489.419193:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c013d7600/0x133f221c08775e8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b295ff expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048489.419204:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c013d7600/0x133f221c08775e8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b295ff expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048489.419212:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c013d7600, rc 0) 00000100:00100000:1.0:1789048489.419365:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+9:6169:x1875953097643648:12345-192.168.202.16@tcp:101: Request processed in 201us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048489.419374:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 245 00000100:00100000:0.0:1789048489.440684:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048489.440906:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097643776 00000100:00100000:1.0:1789048489.440918:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097643776 00000100:00100000:1.0:1789048489.441534:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 246 00000100:00100000:1.0:1789048489.441547:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+9:6169:x1875953097643776:12345-192.168.202.16@tcp:501: 00000100:00100000:1.0:1789048489.443910:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+9:6169:x1875953097643776:12345-192.168.202.16@tcp:501: Request processed in 2355us (3226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048489.443926:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 246 00000100:00100000:0.0:1789048489.455870:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048489.456031:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097643904 00000100:00100000:2.0:1789048489.456040:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097643904 00000100:00100000:2.0:1789048489.456113:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 247 00000100:00100000:2.0:1789048489.456124:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+9:6169:x1875953097643904:12345-192.168.202.16@tcp:503: 00000100:00100000:2.0:1789048489.456628:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+9:6169:x1875953097643904:12345-192.168.202.16@tcp:503: Request processed in 505us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048489.456646:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 247 00000100:00100000:2.0:1789048489.468461:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048489.468835:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097644032 00000100:00100000:1.0:1789048489.468845:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097644032 00000100:00100000:1.0:1789048489.468943:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 248 00000100:00100000:1.0:1789048489.468953:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+9:6652:x1875953097644032:12345-192.168.202.16@tcp:502: 00000100:00100000:1.0:1789048489.469141:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+9:6652:x1875953097644032:12345-192.168.202.16@tcp:502: Request processed in 189us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048489.469149:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 248 00000100:00100000:0.0:1789048489.479823:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048489.479932:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097644160 00000100:00100000:2.0:1789048489.479943:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097644160 00000100:00100000:2.0:1789048489.480009:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 249 00000100:00100000:2.0:1789048489.480020:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+9:6652:x1875953097644160:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789048489.480216:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+9:6652:x1875953097644160:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 197us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048489.480237:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 249 00000100:00100000:0.0:1789048489.491115:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048489.491284:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097644288 00000100:00100000:2.0:1789048489.491296:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097644288 00000100:00100000:1.0:1789048489.492268:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 250 00000100:00100000:1.0:1789048489.492286:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+9:6169:x1875953097644288:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048489.492305:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048489.492326:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c00031600/0x133f221c08775e94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29606 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048489.492395:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c00031600/0x133f221c08775e94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29606 expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048489.492418:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c00031600/0x133f221c08775e94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29606 expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048489.492441:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c00031600, rc 0) 00000100:00100000:1.0:1789048489.492501:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:6169:x1875953097644288:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 221us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048489.492509:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 250 00000100:00100000:0.0:1789048489.497887:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048489.497975:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097644416 00000100:00100000:3.0:1789048489.497998:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097644416 00000100:00100000:3.0:1789048489.498054:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 251 00000100:00100000:3.0:1789048489.498063:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:6169:x1875953097644416:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048489.498190:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:6169:x1875953097644416:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 127us (312us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789048489.498198:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 251 00010000:00010000:1.0:1789048489.949628:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048490.463495:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111335040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048490.463583:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048490.463655:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111335040 00000100:00100000:0.0:1789048490.463663:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111335040 00000100:00100000:0.0:1789048490.463713:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789048490.463723:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111335040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789048490.463755:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048490.463797:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111335040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048490.463804:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1789048490.463826:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789048490.463857:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb2b100 x1875953111335040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048506 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048490.463888:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111335040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048490.464131:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789048490.464142:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111335168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048490.464172:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048490.464197:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111335168 00000100:00100000:3.0:1789048490.464201:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111335168 00000100:00100000:3.0:1789048490.464247:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789048490.464253:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111335168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789048490.464265:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048490.464296:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111335168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048490.464301:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1789048490.464317:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789048490.464354:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb57480 x1875953111335168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048506 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048490.464367:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111335168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789048490.465687:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111335680:0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.465738:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048490.465765:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111336192:0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.465788:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048490.465810:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789048490.465816:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111335296:0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.465842:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048490.465865:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111335808:0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.465888:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048490.465905:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111336320:0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.465924:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048490.465951:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111335680 00000100:00100000:0.0:1789048490.465957:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111335680 00000100:00100000:0.0:1789048490.465996:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789048490.466005:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111335680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.466051:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111335680:12345-0@lo:400:kworker.0 Request processed in 47us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048490.466058:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789048490.466079:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111336192 00000100:00100000:0.0:1789048490.466082:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111336192 00000100:00100000:0.0:1789048490.466112:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111336320 00000100:00100000:0.0:1789048490.466115:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111336320 00000100:00100000:0.0:1789048490.466133:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789048490.466139:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111336192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.466182:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111336192:12345-0@lo:400:kworker.0 Request processed in 43us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048490.466188:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789048490.466201:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789048490.466207:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111336320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.466243:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111336320:12345-0@lo:400:kworker.0 Request processed in 37us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048490.466249:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789048490.466267:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111335808 00000100:00100000:0.0:1789048490.466271:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111335808 00000100:00100000:0.0:1789048490.466294:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789048490.466300:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111335808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.466329:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111335808:12345-0@lo:400:kworker.0 Request processed in 29us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048490.466356:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789048490.466389:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111335552:0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.466413:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048490.466430:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111336064:0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.466448:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048490.466463:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111336576:0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.466481:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048490.466499:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789048490.466505:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111335424:0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.466525:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048490.466540:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111335936:0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.466569:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048490.466585:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875953111336448:0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.466604:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048490.466625:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111335552 00000100:00100000:0.0:1789048490.466629:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111335552 00000100:00100000:0.0:1789048490.466652:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789048490.466658:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111335552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.466691:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111335552:12345-0@lo:400:kworker.0 Request processed in 33us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048490.466697:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789048490.466713:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111336064 00000100:00100000:0.0:1789048490.466716:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111336064 00000100:00100000:0.0:1789048490.466732:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111336576 00000100:00100000:0.0:1789048490.466735:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111336576 00000100:00100000:0.0:1789048490.466746:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111335424 00000100:00100000:0.0:1789048490.466748:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111335424 00000100:00100000:0.0:1789048490.466759:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111335936 00000100:00100000:0.0:1789048490.466761:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111335936 00000100:00100000:0.0:1789048490.466772:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111336448 00000100:00100000:0.0:1789048490.466775:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111336448 00000100:00100000:0.0:1789048490.466786:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789048490.466791:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111336064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.466820:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111336064:12345-0@lo:400:kworker.0 Request processed in 29us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048490.466826:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789048490.466840:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789048490.466844:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111336576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.466870:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111336576:12345-0@lo:400:kworker.0 Request processed in 26us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048490.466884:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789048490.466895:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789048490.466901:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111335424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.466945:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111335424:12345-0@lo:400:kworker.0 Request processed in 44us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048490.466951:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789048490.466963:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789048490.466968:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111335936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.466993:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111335936:12345-0@lo:400:kworker.0 Request processed in 25us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048490.466999:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789048490.467009:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789048490.467015:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875953111336448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.467039:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875953111336448:12345-0@lo:400:kworker.0 Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048490.467045:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789048490.467087:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111335808:0@lo:400:kworker.0 00010000:00080000:0.0:1789048490.467101:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb4ca80 x1875953111336320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048490.467111:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111336320:0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.467121:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111335680:0@lo:400:kworker.0 00010000:00080000:0.0:1789048490.467131:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb4f100 x1875953111336192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048490.467152:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111336192:0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.467187:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111335424:0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.467196:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111335936:0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.467203:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875953111336448:0@lo:400:kworker.0 00000100:00100000:0.0:1789048490.467211:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111335552:0@lo:400:kworker.0 00010000:00080000:0.0:1789048490.467235:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d76680 x1875953111336064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048490.467244:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111336064:0@lo:400:kworker.0 00010000:00080000:0.0:1789048490.467264:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb4f480 x1875953111336576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048490.467272:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111336576:0@lo:400:kworker.0 00000100:00080000:3.0:1789048490.468206:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048490.468212:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789048490.468225:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048490.469808:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111335296 00000100:00100000:2.0:1789048490.469818:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111335296 00000100:00100000:2.0:1789048490.469914:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789048490.469925:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111335296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048490.470018:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111335296:12345-0@lo:400:kworker.0 Request processed in 95us (4174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048490.470025:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789048490.472429:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111335296:0@lo:400:kworker.0 00000020:00000080:0.0:1789048490.796012:0:10374:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3909c290 20000000:00000080:0.0:1789048490.796031:0:10374:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff959b07a90400 uarg=0000000000000000 20000000:01000000:0.0:1789048490.796075:0:10374:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789048490.796081:0:10374:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789048490.796085:0:10374:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789048490.796697:0:10375:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789048490.796857:0:10374:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1789048490.805227:0:10374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1789048490.805639:0:10374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1789048490.805661:0:10374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1789048490.805679:0:10374:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789048490.805711:0:10374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff959c3ef38e00/0x133f221c08775e9b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048490.805730:0:10374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c0147bc00/0x133f221c08775b37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775b30 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048490.805738:0:10374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c0147be00/0x133f221c08775b45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775b3e expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048490.805745:0:10374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c02837e00/0x133f221c08775b99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775b92 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048490.805752:0:10374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c00031000/0x133f221c08775cbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775cb8 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048490.805760:0:10374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c02837400/0x133f221c08775dd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b295c7 expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048490.805767:0:10374:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959c3ef38e00/0x133f221c08775e9b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048490.805804:0:10374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c02837400/0x133f221c08775dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b295c7 expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048490.805819:0:10374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c02837400/0x133f221c08775dd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b295c7 expref: 9 pid: 6492 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048490.805833:0:10374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06971880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10374:1875953111336704:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048490.805925:0:10374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c00031000/0x133f221c08775cbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775cb8 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048490.805945:0:10374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c00031000/0x133f221c08775cbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775cb8 expref: 23 pid: 6491 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048490.805955:0:10374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06970380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10374:1875953111336832:0@lo:104: 00000100:00100000:0.0:1789048490.805994:0:10374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789048490.806035:0:10374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c02837e00/0x133f221c08775b99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775b92 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048490.806044:0:10374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c02837e00/0x133f221c08775b99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775b92 expref: 23 pid: 6492 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048490.806053:0:10374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10374:1875953111336960:0@lo:104: 00000100:00100000:3.0:1789048490.806383:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111336832 00000100:00100000:3.0:1789048490.806390:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111336832 00000100:00100000:3.0:1789048490.806442:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789048490.806452:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:10374:x1875953111336832:12345-0@lo:104: 00010000:00010000:3.0:1789048490.806464:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775cb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775cbf expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048490.806510:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789048490.806516:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:10374:x1875953111336832:12345-0@lo:104: Request processed in 67us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048490.806532:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1789048490.806782:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048490.806789:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775cb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775cbf expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048490.806797:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837200 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048490.806801:0:7447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775cb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775cbf expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048490.806822:0:7447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775cb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775cbf expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048490.806829:0:7447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775cb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775cbf expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048490.806835:0:7447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789048490.806873:0:7447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775cb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775cbf expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048490.806880:0:7447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048490.806902:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775cb8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775cbf expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048490.806909:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c02837200/0x133f221c08775cb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775cbf expref: -99 pid: 9491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048490.806923:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048490.806925:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048490.806926:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048490.806938:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111337088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048490.806969:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048490.807012:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111337088 00000100:00100000:2.0:1789048490.807016:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111337088 00010000:00010000:2.0:1789048490.807034:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c00031000/0x133f221c08775cbf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775cb8 expref: 24 pid: 6491 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048490.807056:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789048490.807062:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111337088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048490.807079:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048490.807084:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c00031000/0x133f221c08775cbf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775cb8 expref: 24 pid: 6491 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048490.807093:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c00031000/0x133f221c08775cbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775cb8 expref: 24 pid: 6491 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048490.807107:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048490.807136:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111337088:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048490.807142:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789048490.807179:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111337088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789048490.807964:0:10374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789048490.808010:0:10374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c0147be00/0x133f221c08775b45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775b3e expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048490.808022:0:10374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c0147be00/0x133f221c08775b45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775b3e expref: 23 pid: 6492 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048490.808033:0:10374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10374:1875953111337216:0@lo:104: 00010000:00010000:0.0:1789048490.808060:0:10374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c0147bc00/0x133f221c08775b37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775b30 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048490.808067:0:10374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c0147bc00/0x133f221c08775b37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775b30 expref: 23 pid: 6490 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048490.808075:0:10374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10374:1875953111337344:0@lo:104: 00000100:00100000:0.0:1789048490.808092:0:10374:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41497540 going to sleep for 11 seconds 00010000:00010000:0.0:1789048490.808117:0:10374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c00031000/0x133f221c08775cbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775cb8 expref: 23 pid: 6491 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048490.808129:0:10374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06970380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10374:1875953111336832:0@lo:104: 00000100:00100000:1.0:1789048490.808426:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789048490.808446:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048490.808473:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048490.808491:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111336960 00000100:00100000:1.0:1789048490.808497:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111336960 00000100:00100000:1.0:1789048490.808527:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111337216 00000100:00100000:1.0:1789048490.808530:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111337216 00000100:00100000:1.0:1789048490.808540:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111337344 00000100:00100000:1.0:1789048490.808550:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111337344 00000100:00100000:1.0:1789048490.808564:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789048490.808571:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+5:10374:x1875953111336960:12345-0@lo:104: 00010000:00010000:1.0:1789048490.808582:0:8428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c013d6000/0x133f221c08775b92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775b99 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.808626:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789048490.808632:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+5:10374:x1875953111336960:12345-0@lo:104: Request processed in 62us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048490.808638:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789048490.808672:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789048490.808678:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:10374:x1875953111337216:12345-0@lo:104: 00010000:00010000:1.0:1789048490.808686:0:8428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775b3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775b45 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.808728:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789048490.808734:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:10374:x1875953111337216:12345-0@lo:104: Request processed in 56us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048490.808739:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789048490.808753:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789048490.808759:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:10374:x1875953111337344:12345-0@lo:104: 00010000:00010000:1.0:1789048490.808765:0:8428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c02837800/0x133f221c08775b30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775b37 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.808791:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789048490.808796:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:10374:x1875953111337344:12345-0@lo:104: Request processed in 39us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048490.808801:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1789048490.808819:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789048490.808824:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c013d6000/0x133f221c08775b92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775b99 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.808831:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c013d6000 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048490.808834:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c013d6000/0x133f221c08775b92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775b99 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.808841:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c013d6000/0x133f221c08775b92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775b99 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048490.808848:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c013d6000/0x133f221c08775b92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775b99 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048490.808854:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789048490.808884:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c013d6000/0x133f221c08775b92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775b99 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.808890:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048490.808905:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c013d6000/0x133f221c08775b92 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775b99 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.808912:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c013d6000/0x133f221c08775b92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775b99 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.808923:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789048490.808926:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775b3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775b45 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.808931:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837000 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048490.808934:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775b3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775b45 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.808941:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775b3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775b45 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048490.808947:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775b3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775b45 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048490.808951:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789048490.808963:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775b3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775b45 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.808969:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048490.808984:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775b3e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775b45 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.809001:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775b3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775b45 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.809012:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048490.809014:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c02837800/0x133f221c08775b30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775b37 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.809019:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837800 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048490.809022:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c02837800/0x133f221c08775b30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775b37 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.809028:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c02837800/0x133f221c08775b30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775b37 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048490.809033:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c02837800/0x133f221c08775b30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775b37 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048490.809037:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789048490.809049:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c02837800/0x133f221c08775b30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775b37 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.809055:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048490.809061:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c02837800/0x133f221c08775b30 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775b37 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.809067:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c02837800/0x133f221c08775b30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775b37 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.809078:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048490.809085:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048490.809087:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048490.809101:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111337728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789048490.809128:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048490.809160:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789048490.809165:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111337600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789048490.809186:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048490.809208:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111337728 00000100:00100000:1.0:1789048490.809228:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111337728 00010000:00010000:1.0:1789048490.809247:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c0147bc00/0x133f221c08775b37 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775b30 expref: 23 pid: 6490 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048490.809275:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111337600 00000100:00100000:1.0:1789048490.809278:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111337600 00010000:00010000:1.0:1789048490.809288:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c0147be00/0x133f221c08775b45 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775b3e expref: 24 pid: 6492 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048490.809300:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789048490.809306:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3621:x1875953111337728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789048490.809315:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048490.809320:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c0147bc00/0x133f221c08775b37 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775b30 expref: 24 pid: 6490 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.809328:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c0147bc00/0x133f221c08775b37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775b30 expref: 24 pid: 6490 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.809370:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048490.809398:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3621:x1875953111337728:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048490.809404:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789048490.809424:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789048490.809430:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:3621:x1875953111337600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789048490.809438:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048490.809442:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c0147be00/0x133f221c08775b45 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775b3e expref: 23 pid: 6492 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.809450:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c0147be00/0x133f221c08775b45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775b3e expref: 23 pid: 6492 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.809459:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048490.809480:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:3621:x1875953111337600:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048490.809486:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789048490.809514:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111337600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789048490.809521:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111337728:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048490.810937:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048490.810958:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111337472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048490.811011:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048490.811062:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111337472 00000100:00100000:2.0:1789048490.811068:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111337472 00010000:00010000:2.0:1789048490.811093:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c02837e00/0x133f221c08775b99 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775b92 expref: 23 pid: 6492 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048490.811113:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789048490.811120:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2aecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:3623:x1875953111337472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048490.811131:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048490.811135:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c02837e00/0x133f221c08775b99 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775b92 expref: 23 pid: 6492 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048490.811143:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c02837e00/0x133f221c08775b99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775b92 expref: 23 pid: 6492 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048490.811172:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048490.811203:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2aecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:3623:x1875953111337472:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048490.811223:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789048490.811303:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111337472:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048490.811325:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048490.811763:0:10374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c02837e00/0x133f221c08775b99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775b92 expref: 22 pid: 6492 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048490.811776:0:10374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10374:1875953111336960:0@lo:104: 00010000:00010000:0.0:1789048490.811786:0:10374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c0147be00/0x133f221c08775b45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775b3e expref: 21 pid: 6492 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048490.811794:0:10374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10374:1875953111337216:0@lo:104: 00010000:00010000:0.0:1789048490.811803:0:10374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c0147bc00/0x133f221c08775b37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775b30 expref: 20 pid: 6490 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048490.811810:0:10374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10374:1875953111337344:0@lo:104: 00000100:00100000:2.0:1789048490.817947:0:10374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06971880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10374:1875953111336704:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789048490.817988:0:10374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff959c3ef38e00/0x133f221c08775e9b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048490.827306:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048490.827486:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097644544 00000100:00100000:2.0:1789048490.827497:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097644544 00010000:00010000:2.0:1789048490.827539:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c02837400/0x133f221c08775dd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b295c7 expref: 10 pid: 6492 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048490.827596:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:2.0:1789048490.827607:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2393:x1875953097644544:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048490.827622:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048490.827628:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c02837400/0x133f221c08775dd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b295c7 expref: 10 pid: 6492 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048490.827641:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c02837400/0x133f221c08775dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b295c7 expref: 10 pid: 6492 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048490.827657:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c02837400/0x133f221c08775dd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b295c7 expref: 10 pid: 6492 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048490.827698:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959c3ef38e00/0x133f221c08775e9b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048490.827706:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef38e00/0x133f221c08775e9b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048490.827723:0:6482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef38e00/0x133f221c08775e9b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048490.827733:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef38e00/0x133f221c08775e9b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048490.827739:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff959c3ef38e00/0x133f221c08775e9b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048490.827746:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff959c3ef38e00/0x133f221c08775e9b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048490.827753:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38e00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048490.827757:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff959c3ef38e00/0x133f221c08775e9b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048490.827764:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff959c3ef38e00/0x133f221c08775e9b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048490.827784:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff959c3ef38e00/0x133f221c08775e9b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048490.827795:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048490.827903:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+9:2393:x1875953097644544:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 297us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048490.827918:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 39 00010000:00010000:3.0:1789048490.828262:0:10374:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff959c3ef38e00/0x133f221c08775e9b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048490.828272:0:10374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff959c3ef38e00/0x133f221c08775e9b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048490.828278:0:10374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef38e00/0x133f221c08775e9b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048490.923645:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048490.938197:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097644672 00000100:00100000:1.0:1789048490.938224:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097644672 00000100:00100000:1.0:1789048490.938303:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 253 00000100:00100000:1.0:1789048490.938314:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+9:6169:x1875953097644672:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048490.938363:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048490.938384:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c00030a00/0x133f221c08775ea2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b2960d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.938415:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c00030a00/0x133f221c08775ea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2960d expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.938425:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c00030a00/0x133f221c08775ea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2960d expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048490.938449:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c00030a00, rc 0) 00000100:00100000:1.0:1789048490.938516:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:6169:x1875953097644672:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 204us (14880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048490.938523:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 253 00000100:00100000:1.0:1789048490.942289:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048490.942410:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097644800 00000100:00100000:3.0:1789048490.942420:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097644800 00000100:00100000:3.0:1789048490.942471:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 254 00000100:00100000:3.0:1789048490.942482:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:6169:x1875953097644800:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048490.942640:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:6169:x1875953097644800:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 157us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048490.942649:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 254 00000100:00100000:1.0:1789048490.972643:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048490.972843:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097644928 00000100:00100000:3.0:1789048490.972854:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097644928 00000100:00100000:3.0:1789048490.972911:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 255 00000100:00100000:3.0:1789048490.972922:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:6169:x1875953097644928:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789048490.973069:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:6169:x1875953097644928:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 149us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048490.973085:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 255 00010000:00010000:1.0:1789048490.973597:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048490.983260:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789048490.984582:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048490.984991:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097645056 00000100:00100000:3.0:1789048490.985001:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097645056 00000100:00100000:3.0:1789048490.985082:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 256 00000100:00100000:3.0:1789048490.985094:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:6677:x1875953097645056:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789048490.985248:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:6677:x1875953097645056:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 155us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048490.985255:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 256 00000100:00100000:0.0:1789048490.989818:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111337856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789048490.989893:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048490.991896:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048490.993994:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097645184 00000100:00100000:3.0:1789048490.994009:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097645184 00000100:00100000:3.0:1789048490.994093:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 257 00000100:00100000:3.0:1789048490.994104:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:6677:x1875953097645184:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789048490.994281:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:6677:x1875953097645184:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 178us (2390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048490.994289:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 257 00000100:00100000:2.0:1789048490.999660:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111337856 00000100:00100000:2.0:1789048490.999676:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111337856 00000100:00100000:2.0:1789048490.999870:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789048490.999881:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111337856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789048490.999920:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789048491.000019:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111337856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (10125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048491.000027:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789048491.000118:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111337856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789048491.485553:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789048491.485580:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111337984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789048491.485669:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048491.485748:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111337984 00000100:00100000:0.0:1789048491.485756:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111337984 00000100:00100000:0.0:1789048491.485812:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789048491.485821:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111337984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789048491.485855:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048491.486121:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111337984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048491.486130:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1789048491.486175:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d77100 x1875953111337984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048491.486214:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111337984:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789048491.486730:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111338112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789048491.486767:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048491.486850:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111338112 00000100:00100000:0.0:1789048491.486855:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111338112 00000100:00100000:0.0:1789048491.486932:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789048491.486941:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111338112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789048491.486956:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048491.487001:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111338112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048491.487007:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1789048491.487068:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d77100 x1875953111338112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048491.487083:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111338112:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789048492.002566:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789048492.445765:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789048492.445774:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959b06952000 from 4 10000000:01000000:3.0:1789048492.445778:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789048492.445823:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3de00/0x133f221c08775ea9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048492.445833:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef3de00/0x133f221c08775ea9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048492.445841:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef3de00/0x133f221c08775ea9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048492.445861:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111338240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789048492.445921:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048492.446080:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c03198600 going to sleep for 11 seconds 00000100:00100000:2.0:1789048492.448443:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111338240 00000100:00100000:2.0:1789048492.448457:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111338240 00000100:00100000:2.0:1789048492.448529:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789048492.448539:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:6494:x1875953111338240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048492.448555:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048492.449998:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c02837800/0x133f221c08775eb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775ea9 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048492.450046:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c02837800/0x133f221c08775eb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775ea9 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048492.450060:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c02837800/0x133f221c08775eb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775ea9 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048492.450084:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02837800, rc 0) 00000100:00100000:2.0:1789048492.450215:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111338240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1676us (4291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048492.450223:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789048492.450540:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111338240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048492.450561:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef3de00/0x133f221c08775ea9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775eb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048492.450570:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3de00/0x133f221c08775ea9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775eb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048492.450834:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111338368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048492.450873:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048492.450975:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c03198600 going to sleep for 11 seconds 00000100:00100000:0.0:1789048492.451020:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111338368 00000100:00100000:0.0:1789048492.451027:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111338368 00000100:00100000:0.0:1789048492.451101:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789048492.451111:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111338368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048492.451254:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111338368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048492.451262:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789048492.451365:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111338368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048492.451398:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111338496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048492.451442:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048492.451824:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2ae92840 going to sleep for 11 seconds 00000100:00100000:3.0:1789048492.451903:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111338496 00000100:00100000:3.0:1789048492.451909:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111338496 00000100:00100000:0.0:1789048492.452017:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789048492.452025:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111338496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789048492.452121:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111338496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048492.452128:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789048492.452236:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111338496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048492.452912:0:10442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10442:1875953111338624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048492.452956:0:10442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048492.452989:0:10442:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2ae92780 going to sleep for 11 seconds 00000100:00100000:0.0:1789048492.457748:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111338624 00000100:00100000:0.0:1789048492.457765:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111338624 00000100:00100000:0.0:1789048492.457825:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789048492.457836:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:10442:x1875953111338624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048492.458035:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:10442:x1875953111338624:12345-0@lo:502:llog_process_th.0 Request processed in 201us (5079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048492.458044:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789048492.459423:0:10442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10442:1875953111338624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789048492.459481:0:10442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048492.459495:0:10442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048492.459498:0:10442:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789048492.459514:0:10442:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959b06952000 00000020:00000080:1.0:1789048492.459517:0:10442:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789048492.459638:0:10442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10442:1875953111338752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048492.459700:0:10442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048492.459737:0:10442:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef216c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048492.460040:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111338752 00000100:00100000:3.0:1789048492.460047:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111338752 00000100:00100000:3.0:1789048492.460079:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789048492.460088:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:10442:x1875953111338752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048492.460193:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:10442:x1875953111338752:12345-0@lo:502:llog_process_th.0 Request processed in 105us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048492.460211:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789048492.468471:0:10442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10442:1875953111338752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789048492.468519:0:10442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048492.468526:0:10442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048492.468528:0:10442:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789048492.468531:0:10442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789048492.471648:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789048492.471692:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789048492.471704:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3de00/0x133f221c08775ea9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775eb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048492.471714:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef3de00/0x133f221c08775ea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775eb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048492.471723:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789048492.471725:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c41779800 from 4 10000000:01000000:1.0:1789048492.471727:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789048492.471760:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775eb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048492.471765:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775eb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048492.471773:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775eb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048492.471792:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111338880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789048492.471856:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048492.471889:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef216c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048492.471916:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111338880 00000100:00100000:1.0:1789048492.471921:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111338880 00000100:00100000:1.0:1789048492.471969:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789048492.471975:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111338880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048492.471986:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048492.471996:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c00031200/0x133f221c08775ebe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775eb7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048492.472012:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c00031200/0x133f221c08775ebe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775eb7 expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048492.472019:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c00031200/0x133f221c08775ebe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775eb7 expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048492.472026:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c00031200, rc 0) 00000100:00100000:1.0:1789048492.472051:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111338880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048492.472056:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789048492.472091:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111338880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048492.472101:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775eb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775ebe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048492.472107:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775eb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775ebe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048492.472145:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111339008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048492.472166:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048492.472175:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef216c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048492.472185:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111339008 00000100:00100000:1.0:1789048492.472188:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111339008 00000100:00100000:1.0:1789048492.472220:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789048492.472226:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111339008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048492.474728:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111339008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2494us (2552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048492.474741:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789048492.478766:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111339008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048492.478823:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111339136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789048492.478884:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048492.478923:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c031983c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048492.480950:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111339136 00000100:00100000:1.0:1789048492.480964:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111339136 00000100:00100000:1.0:1789048492.481019:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789048492.481029:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111339136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048492.481176:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111339136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (2291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048492.481184:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789048492.497639:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111339136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789048492.498281:0:10445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10445:1875953111339264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048492.498390:0:10445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048492.498429:0:10445:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c03198180 going to sleep for 11 seconds 00000100:00100000:0.0:1789048492.498497:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111339264 00000100:00100000:0.0:1789048492.498503:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111339264 00000100:00100000:0.0:1789048492.498560:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789048492.498573:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:10445:x1875953111339264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048492.498705:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:10445:x1875953111339264:12345-0@lo:502:llog_process_th.0 Request processed in 134us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048492.498712:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789048492.498919:0:10445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10445:1875953111339264:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789048492.498945:0:10445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048492.498954:0:10445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048492.498956:0:10445:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789048492.498962:0:10445:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959c41779800 00000020:00000080:3.0:1789048492.498965:0:10445:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789048492.499034:0:10445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10445:1875953111339392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048492.499072:0:10445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048492.499096:0:10445:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c03198180 going to sleep for 11 seconds 00000100:00100000:1.0:1789048492.499818:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111339392 00000100:00100000:1.0:1789048492.499826:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111339392 00000100:00100000:1.0:1789048492.499872:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789048492.499881:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:10445:x1875953111339392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048492.499994:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:10445:x1875953111339392:12345-0@lo:502:llog_process_th.0 Request processed in 114us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048492.500002:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789048492.500395:0:10445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10445:1875953111339392:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789048492.500424:0:10445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048492.500430:0:10445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048492.500433:0:10445:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789048492.500436:0:10445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789048492.501372:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789048492.501403:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789048492.501415:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775eb7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775ebe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048492.501426:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775eb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775ebe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048492.501437:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789048492.501440:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c414c7000 from 4 10000000:01000000:0.0:1789048492.501443:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789048492.501475:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef38200/0x133f221c08775ec5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048492.501483:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef38200/0x133f221c08775ec5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048492.501501:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef38200/0x133f221c08775ec5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048492.501525:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111339520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789048492.501594:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048492.501632:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c02c49b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789048492.501654:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111339520 00000100:00100000:0.0:1789048492.501660:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111339520 00000100:00100000:0.0:1789048492.501706:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789048492.501714:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111339520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789048492.501726:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048492.501739:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef39800/0x133f221c08775ecc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775ec5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048492.501762:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef39800/0x133f221c08775ecc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775ec5 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048492.501773:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef39800/0x133f221c08775ecc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775ec5 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048492.501781:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39800, rc 0) 00000100:00100000:0.0:1789048492.501814:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111339520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048492.501820:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789048492.501851:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111339520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789048492.501864:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef38200/0x133f221c08775ec5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775ecc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048492.501880:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef38200/0x133f221c08775ec5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775ecc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048492.501935:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111339648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048492.501963:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048492.501971:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c02c49b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789048492.501987:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111339648 00000100:00100000:0.0:1789048492.501990:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111339648 00000100:00100000:0.0:1789048492.502005:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789048492.502011:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111339648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048492.502101:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111339648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048492.502108:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789048492.502128:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111339648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048492.502152:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111339776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789048492.502185:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048492.502194:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c02c49b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789048492.502221:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111339776 00000100:00100000:0.0:1789048492.502224:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111339776 00000100:00100000:0.0:1789048492.502240:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789048492.502257:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111339776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789048492.502361:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111339776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048492.502368:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789048492.502402:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111339776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048492.512698:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111340032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048492.512762:0:10446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10446:1875953111339904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048492.518088:0:10446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048492.518145:0:10446:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c03198180 going to sleep for 11 seconds 00000100:00100000:2.0:1789048492.521325:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048492.522050:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111340032 00000100:00100000:3.0:1789048492.522062:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111340032 00000100:00100000:3.0:1789048492.522118:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789048492.522127:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111340032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789048492.522163:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789048492.522236:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111340032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048492.522244:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789048492.522894:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111340032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048492.524172:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111339904 00000100:00100000:0.0:1789048492.524183:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111339904 00000100:00100000:0.0:1789048492.524246:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789048492.524255:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:10446:x1875953111339904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048492.524438:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:10446:x1875953111339904:12345-0@lo:502:llog_process_th.0 Request processed in 184us (6359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048492.524446:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789048492.524794:0:10446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10446:1875953111339904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789048492.524832:0:10446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048492.524841:0:10446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048492.524844:0:10446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789048492.524850:0:10446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959c414c7000 00000020:00000080:3.0:1789048492.524852:0:10446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789048492.525283:0:10446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10446:1875953111340160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048492.525355:0:10446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048492.525391:0:10446:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c03198180 going to sleep for 11 seconds 00000100:00100000:1.0:1789048492.527138:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111340160 00000100:00100000:1.0:1789048492.527151:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111340160 00000100:00100000:1.0:1789048492.527210:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789048492.527220:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:10446:x1875953111340160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048492.527385:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:10446:x1875953111340160:12345-0@lo:502:llog_process_th.0 Request processed in 167us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048492.527393:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789048492.535933:0:10446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10446:1875953111340160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789048492.535982:0:10446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048492.535992:0:10446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048492.535995:0:10446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789048492.535999:0:10446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789048492.536420:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789048492.536446:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789048492.536457:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef38200/0x133f221c08775ec5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775ecc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048492.536470:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef38200/0x133f221c08775ec5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775ecc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048492.536482:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789048492.536485:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c335d0800 from 4 10000000:01000000:1.0:1789048492.536488:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789048492.536524:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775ed3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048492.536533:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775ed3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048492.536544:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775ed3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048492.536568:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111340288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789048492.536645:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048492.536684:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c0383f540 going to sleep for 11 seconds 00000100:00100000:1.0:1789048492.536704:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111340288 00000100:00100000:1.0:1789048492.536711:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111340288 00000100:00100000:1.0:1789048492.536759:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789048492.536770:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111340288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048492.536793:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048492.536806:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c00031a00/0x133f221c08775eda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775ed3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048492.536829:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c00031a00/0x133f221c08775eda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775ed3 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048492.536840:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c00031a00/0x133f221c08775eda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775ed3 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048492.536849:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c00031a00, rc 0) 00000100:00100000:1.0:1789048492.536890:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:6494:x1875953111340288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048492.536897:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789048492.536936:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111340288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048492.536948:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775ed3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775eda expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048492.536957:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775ed3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775eda expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048492.537011:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111340416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048492.537035:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048492.537050:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c0383f540 going to sleep for 11 seconds 00000100:00100000:1.0:1789048492.537062:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111340416 00000100:00100000:1.0:1789048492.537065:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111340416 00000100:00100000:1.0:1789048492.537088:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789048492.537095:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:6494:x1875953111340416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048492.537218:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:6494:x1875953111340416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048492.537225:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789048492.537255:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111340416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048492.537277:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111340544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048492.537311:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048492.537324:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c0383f540 going to sleep for 11 seconds 00000100:00100000:1.0:1789048492.537358:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111340544 00000100:00100000:1.0:1789048492.537361:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111340544 00000100:00100000:1.0:1789048492.537382:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789048492.537388:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:6494:x1875953111340544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048492.537463:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:6494:x1875953111340544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048492.537469:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789048492.537504:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111340544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789048492.545765:0:10448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10448:1875953111340672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048492.545855:0:10448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048492.545903:0:10448:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b07b08840 going to sleep for 11 seconds 00000100:00100000:3.0:1789048492.547300:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111340672 00000100:00100000:3.0:1789048492.547312:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111340672 00000100:00100000:3.0:1789048492.547408:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789048492.547419:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:10448:x1875953111340672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048492.547562:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:10448:x1875953111340672:12345-0@lo:502:llog_process_th.0 Request processed in 145us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048492.547570:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789048492.548204:0:10448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10448:1875953111340672:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789048492.548243:0:10448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048492.548253:0:10448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048492.548255:0:10448:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789048492.548263:0:10448:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959c335d0800 00000020:00000080:0.0:1789048492.548266:0:10448:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789048492.548375:0:10448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10448:1875953111340800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048492.548422:0:10448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048492.548453:0:10448:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b07b08840 going to sleep for 11 seconds 00000100:00100000:1.0:1789048492.554481:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111340800 00000100:00100000:1.0:1789048492.554498:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111340800 00000100:00100000:1.0:1789048492.554568:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789048492.554591:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:10448:x1875953111340800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048492.554782:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:10448:x1875953111340800:12345-0@lo:502:llog_process_th.0 Request processed in 204us (6358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048492.554790:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789048492.554884:0:10448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:10448:1875953111340800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789048492.554924:0:10448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789048492.554933:0:10448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048492.554935:0:10448:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789048492.554941:0:10448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789048492.555030:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789048492.555056:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789048492.555067:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775ed3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775eda expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048492.555085:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775ed3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775eda expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048492.610688:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048492.616875:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097645312 00000100:00100000:1.0:1789048492.616891:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097645312 00000100:00100000:1.0:1789048492.616957:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 278 00000100:00100000:1.0:1789048492.616968:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2394:x1875953097645312:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048492.617058:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2394:x1875953097645312:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 91us (6380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048492.617081:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 278 00000100:00100000:0.0:1789048492.622807:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048492.622869:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048492.622886:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048492.623440:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048492.623465:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097645696 00000100:00100000:0.0:1789048492.623475:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097645696 00000100:00100000:0.0:1789048492.623539:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097645824 00000100:00100000:0.0:1789048492.623547:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097645824 00000100:00100000:0.0:1789048492.623570:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:0.0:1789048492.623591:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097645696:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048492.623671:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097645696:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 92us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048492.623679:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:0.0:1789048492.623695:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:0.0:1789048492.623702:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097645824:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048492.623726:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097645824:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 24us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048492.623732:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:3.0:1789048492.624048:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097645440 00000100:00100000:3.0:1789048492.624052:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097645440 00000100:00100000:3.0:1789048492.624088:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097645568 00000100:00100000:3.0:1789048492.624091:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097645568 00000100:00100000:3.0:1789048492.624110:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 75 00000100:00100000:3.0:1789048492.624116:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097645440:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048492.624154:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097645440:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 38us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048492.624160:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 75 00000100:00100000:3.0:1789048492.624174:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 76 00000100:00100000:3.0:1789048492.624298:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097645568:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048492.624330:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097645568:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 150us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048492.624360:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 76 00000100:00080000:3.0:1789048492.624382:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789048492.624386:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048492.624389:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789048492.624450:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789048493.022854:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048494.047510:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048495.069535:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048495.585706:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789048495.585748:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111340928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789048495.585870:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048495.586014:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111340928 00000100:00100000:1.0:1789048495.586049:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111340928 00000100:00100000:1.0:1789048495.586204:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789048495.586231:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111340928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789048495.586303:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048495.586440:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111340928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 213us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048495.586448:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1789048495.586475:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789048495.586518:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0810b100 x1875953111340928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048511 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048495.586569:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111340928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048495.587513:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789048495.587531:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111341056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048495.587590:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048495.587711:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111341056 00000100:00100000:1.0:1789048495.587719:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111341056 00000100:00100000:1.0:1789048495.587787:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789048495.587797:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111341056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789048495.587820:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048495.587866:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111341056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048495.587874:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1789048495.587910:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0810b100 x1875953111341056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048511 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048495.587927:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111341056:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789048495.587975:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789048495.599015:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111341440:0@lo:400:kworker.0 00000100:00100000:3.0:1789048495.599132:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048495.599183:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111341952:0@lo:400:kworker.0 00000100:00100000:3.0:1789048495.599213:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048495.599234:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111342464:0@lo:400:kworker.0 00000100:00100000:3.0:1789048495.599255:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048495.599284:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789048495.599290:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111341568:0@lo:400:kworker.0 00000100:00100000:3.0:1789048495.599312:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048495.599371:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111342080:0@lo:400:kworker.0 00000100:00100000:3.0:1789048495.600020:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048495.600094:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111341952 00000100:00100000:3.0:1789048495.600104:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111341952 00000100:00100000:3.0:1789048495.600183:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111342464 00000100:00100000:3.0:1789048495.600187:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111342464 00000100:00100000:3.0:1789048495.600204:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111341568 00000100:00100000:3.0:1789048495.600207:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111341568 00000100:00100000:3.0:1789048495.600222:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789048495.600232:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111341952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048495.600305:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111341952:12345-0@lo:400:kworker.0 Request processed in 73us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048495.600312:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789048495.600356:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789048495.600364:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111342464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048495.600396:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111342464:12345-0@lo:400:kworker.0 Request processed in 32us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048495.600402:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789048495.600414:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789048495.600420:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111341568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048495.600445:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111341568:12345-0@lo:400:kworker.0 Request processed in 26us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048495.600451:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789048495.600481:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111342080 00000100:00100000:3.0:1789048495.600486:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111342080 00000100:00100000:3.0:1789048495.600516:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789048495.600522:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111342080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048495.600567:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111342080:12345-0@lo:400:kworker.0 Request processed in 45us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048495.600574:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1789048495.600602:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789048495.600608:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048495.600658:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111341568:0@lo:400:kworker.0 00010000:00080000:3.0:1789048495.600675:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb54000 x1875953111342080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048495.600687:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111342080:0@lo:400:kworker.0 00010000:00080000:3.0:1789048495.600699:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb56a00 x1875953111341952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048495.600708:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111341952:0@lo:400:kworker.0 00010000:00080000:3.0:1789048495.600720:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb57800 x1875953111342464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048495.600728:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111342464:0@lo:400:kworker.0 00000100:00100000:2.0:1789048495.600999:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111341184:0@lo:400:kworker.0 00000100:00100000:2.0:1789048495.601274:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048495.601320:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111341696:0@lo:400:kworker.0 00000100:00100000:2.0:1789048495.601386:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048495.601408:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111342208:0@lo:400:kworker.0 00000100:00100000:2.0:1789048495.601431:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048495.601455:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789048495.601462:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111341312:0@lo:400:kworker.0 00000100:00100000:2.0:1789048495.601484:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048495.601501:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111341824:0@lo:400:kworker.0 00000100:00100000:2.0:1789048495.601521:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048495.601552:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111342336:0@lo:400:kworker.0 00000100:00100000:2.0:1789048495.601574:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048495.601612:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111341440 00000100:00100000:2.0:1789048495.601617:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111341440 00000100:00100000:2.0:1789048495.601655:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111341696 00000100:00100000:2.0:1789048495.601658:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111341696 00000100:00100000:2.0:1789048495.601674:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789048495.601681:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111341440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048495.601730:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111341440:12345-0@lo:400:kworker.0 Request processed in 48us (2598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048495.601737:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789048495.601753:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789048495.601760:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111341696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048495.601790:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111341696:12345-0@lo:400:kworker.0 Request processed in 31us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048495.601796:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789048495.601818:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111342208 00000100:00100000:2.0:1789048495.601822:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111342208 00000100:00100000:2.0:1789048495.601856:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789048495.601863:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111342208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048495.601894:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111342208:12345-0@lo:400:kworker.0 Request processed in 32us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048495.601901:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789048495.601936:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111341696:0@lo:400:kworker.0 00010000:00080000:2.0:1789048495.601949:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb54e00 x1875953111342208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048495.601972:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111342208:0@lo:400:kworker.0 00000100:00100000:2.0:1789048495.602005:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111341312 00000100:00100000:2.0:1789048495.602009:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111341312 00000100:00100000:2.0:1789048495.604438:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111341824 00000100:00100000:2.0:1789048495.604458:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111341824 00000100:00100000:2.0:1789048495.604520:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111342336 00000100:00100000:2.0:1789048495.604524:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111342336 00000100:00100000:2.0:1789048495.604550:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789048495.604562:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111341312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048495.604686:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111341312:12345-0@lo:400:kworker.0 Request processed in 126us (3200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048495.604695:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789048495.604714:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789048495.604721:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111341824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048495.604750:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111341824:12345-0@lo:400:kworker.0 Request processed in 30us (3229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048495.604756:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789048495.604766:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789048495.604772:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111342336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048495.604800:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111342336:12345-0@lo:400:kworker.0 Request processed in 28us (3225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048495.604806:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1789048495.604869:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789048495.604874:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048495.604915:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111341312:0@lo:400:kworker.0 00000100:00100000:2.0:1789048495.604941:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111341824:0@lo:400:kworker.0 00000100:00100000:2.0:1789048495.604953:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111342336:0@lo:400:kworker.0 00000100:00100000:2.0:1789048495.605007:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111341440:0@lo:400:kworker.0 00000100:00100000:3.0:1789048495.605499:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111341184 00000100:00100000:3.0:1789048495.605506:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111341184 00000100:00100000:3.0:1789048495.605555:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789048495.605563:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111341184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048495.605614:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111341184:12345-0@lo:400:kworker.0 Request processed in 51us (4339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048495.605620:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789048495.605804:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111341184:0@lo:400:kworker.0 00000100:00100000:1.0:1789048496.093779:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789048496.093812:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111342592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048496.093906:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789048496.094000:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048496.094644:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111342592 00000100:00100000:3.0:1789048496.094655:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111342592 00000100:00100000:3.0:1789048496.094751:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789048496.094763:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111342592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789048496.094816:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789048496.094902:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111342592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048496.094910:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789048496.095023:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111342592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789048496.607412:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111342720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789048496.607537:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048496.607647:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111342720 00000100:00100000:0.0:1789048496.607656:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111342720 00000100:00100000:0.0:1789048496.607721:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789048496.607732:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08206d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111342720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789048496.607771:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048496.607827:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08206d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111342720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048496.607834:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1789048496.607887:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d77100 x1875953111342720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048496.607908:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111342720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789048496.612523:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789048496.612555:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111342848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789048496.612646:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048496.612718:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111342848 00000100:00100000:0.0:1789048496.612727:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111342848 00000100:00100000:0.0:1789048496.612788:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789048496.612798:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08205180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111342848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789048496.612827:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048496.612878:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08205180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111342848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048496.612885:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1789048496.612936:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08205500 x1875953111342848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048496.612958:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111342848:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789048497.118058:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048497.631883:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789048497.631910:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111342976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789048497.632002:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048497.632078:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111342976 00000100:00100000:2.0:1789048497.632086:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111342976 00000100:00100000:2.0:1789048497.632160:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789048497.632171:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111342976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789048497.632219:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789048497.632269:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111342976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048497.632276:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789048497.632320:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111342976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048497.736979:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048497.737034:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048497.737087:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048497.737120:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097645952 00000100:00100000:0.0:1789048497.737133:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097645952 00000100:00100000:0.0:1789048497.737214:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 280 00000100:00100000:0.0:1789048497.737227:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2394:x1875953097645952:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048497.737320:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2394:x1875953097645952:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 95us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048497.737328:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 280 00000100:00100000:0.0:1789048497.737406:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048497.737665:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097646080 00000100:00100000:1.0:1789048497.737671:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097646080 00000100:00100000:1.0:1789048497.737941:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097646208 00000100:00100000:1.0:1789048497.737946:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097646208 00000100:00100000:1.0:1789048497.737977:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 83 00000100:00100000:1.0:1789048497.737987:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097646080:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048497.738031:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097646080:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 47us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048497.738047:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 83 00000100:00100000:1.0:1789048497.738063:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 84 00000100:00100000:1.0:1789048497.738072:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097646208:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048497.738099:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097646208:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 30us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048497.738105:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 84 00000100:00080000:1.0:1789048497.738121:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789048497.738126:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048497.738399:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097646336 00000100:00100000:3.0:1789048497.738404:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097646336 00000100:00100000:3.0:1789048497.738448:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:3.0:1789048497.738456:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08207800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097646336:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048497.740040:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08207800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097646336:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 1570us (2992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048497.740056:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00080000:1.0:1789048497.740671:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789048497.741189:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048497.742622:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097646464 00000100:00100000:1.0:1789048497.742648:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097646464 00000100:00100000:1.0:1789048497.742839:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:1.0:1789048497.742854:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08204e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097646464:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048497.742965:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08204e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097646464:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 115us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048497.742973:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00080000:3.0:1789048497.743732:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789048498.151444:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789048498.312861:0:10674:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1789048499.179476:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048500.191859:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048500.703431:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111343104:0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.703510:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048500.703562:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111343616:0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.703589:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048500.703610:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111344128:0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.703651:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048500.703670:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111344640:0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.703689:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048500.703714:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789048500.703720:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111343488:0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.703760:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048500.703780:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111344000:0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.703800:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048500.703817:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111344512:0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.703835:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048500.703944:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111343232:0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.703967:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048500.703984:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111343744:0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.704002:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048500.704018:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111344256:0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.704165:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048500.704188:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789048500.704194:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111343360:0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.704216:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048500.704232:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111343872:0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.704252:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048500.704263:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111344384:0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.704280:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048500.704307:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111343616 00000100:00100000:2.0:1789048500.704321:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111343616 00000100:00100000:2.0:1789048500.704386:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111343360 00000100:00100000:3.0:1789048500.704583:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111343104 00000100:00100000:3.0:1789048500.704597:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111343104 00000100:00100000:3.0:1789048500.704663:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789048500.704674:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3623:x1875953111343104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048500.704779:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3623:x1875953111343104:12345-0@lo:400:kworker.0 Request processed in 106us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048500.704787:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789048500.704862:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111343104:0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.706163:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111343360 00000100:00100000:2.0:1789048500.706217:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789048500.706227:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111343616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.706319:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111343616:12345-0@lo:400:kworker.0 Request processed in 93us (2728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048500.706326:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789048500.706357:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789048500.706363:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111343360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.707763:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111343360:12345-0@lo:400:kworker.0 Request processed in 1393us (3538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048500.707776:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789048500.707824:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111344128 00000100:00100000:2.0:1789048500.707832:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111344128 00000100:00100000:2.0:1789048500.707874:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111344640 00000100:00100000:2.0:1789048500.707877:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111344640 00000100:00100000:2.0:1789048500.707890:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111344000 00000100:00100000:2.0:1789048500.707893:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111344000 00000100:00100000:2.0:1789048500.707907:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111344512 00000100:00100000:2.0:1789048500.707909:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111344512 00000100:00100000:2.0:1789048500.707936:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789048500.707946:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111344128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.708023:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111344128:12345-0@lo:400:kworker.0 Request processed in 79us (4369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048500.710262:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789048500.710314:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789048500.710355:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111344640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.710456:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111344640:12345-0@lo:400:kworker.0 Request processed in 130us (6765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048500.710463:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789048500.710479:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789048500.710486:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111344000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.710517:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111344000:12345-0@lo:400:kworker.0 Request processed in 33us (6716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048500.710522:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789048500.710533:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789048500.710539:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0822b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111344512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.710565:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0822b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111344512:12345-0@lo:400:kworker.0 Request processed in 27us (6729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048500.710571:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789048500.710606:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111343488 00000100:00100000:2.0:1789048500.710613:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111343488 00000100:00100000:2.0:1789048500.710654:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111343232 00000100:00100000:2.0:1789048500.710658:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111343232 00000100:00100000:2.0:1789048500.710677:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111343744 00000100:00100000:2.0:1789048500.710681:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111343744 00000100:00100000:2.0:1789048500.710702:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111344256 00000100:00100000:2.0:1789048500.710705:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111344256 00000100:00100000:2.0:1789048500.710720:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111343872 00000100:00100000:2.0:1789048500.710723:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111343872 00000100:00100000:2.0:1789048500.710738:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111344384 00000100:00100000:2.0:1789048500.710742:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111344384 00000100:00100000:2.0:1789048500.710765:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789048500.710777:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111343488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.710817:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111343488:12345-0@lo:400:kworker.0 Request processed in 45us (7057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048500.710830:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789048500.710850:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789048500.710859:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111343232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048500.719669:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08205880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111344896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789048500.719777:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048500.719839:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789048500.719847:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111344768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048500.719873:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048500.719913:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111344896 00000100:00100000:1.0:1789048500.719924:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111344896 00000100:00100000:1.0:1789048500.719976:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111344768 00000100:00100000:1.0:1789048500.719997:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111344768 00000100:00100000:1.0:1789048500.720019:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789048500.720029:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111344896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789048500.720697:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048500.720764:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111344896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 736us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048500.720773:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789048500.720797:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789048500.720805:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111344768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789048500.720816:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048500.720841:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111344768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048500.720848:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1789048500.720901:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08109c00 x1875953111344768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048500.720923:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111344768:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789048500.720934:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08205880 x1875953111344896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048500.720946:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08205880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111344896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048500.722434:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789048500.722577:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111343744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048500.722694:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111343744:12345-0@lo:400:kworker.0 Request processed in 246us (18688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048500.722708:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789048500.722717:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111343232:12345-0@lo:400:kworker.0 Request processed in 11476us (18363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048500.722736:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789048500.722750:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789048500.722761:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111344256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.722791:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789048500.722806:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111344256:12345-0@lo:400:kworker.0 Request processed in 46us (18639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048500.722822:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789048500.722824:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0822bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111343872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048500.722846:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789048500.722857:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111344384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048500.722923:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111344384:12345-0@lo:400:kworker.0 Request processed in 65us (18639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048500.722931:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789048500.722937:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0822bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111343872:12345-0@lo:400:kworker.0 Request processed in 131us (18678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048500.722950:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1789048500.722999:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789048500.723006:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789048500.723010:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789048500.723014:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048500.723224:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111343360:0@lo:400:kworker.0 00010000:00080000:2.0:1789048500.723243:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d82d80 x1875953111343872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048500.723255:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111343872:0@lo:400:kworker.0 00010000:00080000:2.0:1789048500.723266:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d80a80 x1875953111344384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048500.723274:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111344384:0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.723287:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111343232:0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.723319:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111343744:0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.723329:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111344256:0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.723960:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111343488:0@lo:400:kworker.0 00010000:00080000:2.0:1789048500.723974:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d82680 x1875953111344000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048500.723984:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111344000:0@lo:400:kworker.0 00010000:00080000:2.0:1789048500.723997:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c08a8d880 x1875953111344512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048500.724004:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111344512:0@lo:400:kworker.0 00000100:00100000:2.0:1789048500.724014:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111343616:0@lo:400:kworker.0 00010000:00080000:2.0:1789048500.724024:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d81c00 x1875953111344128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048500.724042:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111344128:0@lo:400:kworker.0 00010000:00080000:2.0:1789048500.724054:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c08a8f800 x1875953111344640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048500.724062:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111344640:0@lo:400:kworker.0 00000100:00100000:2.0:1789048501.223778:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111345024:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048501.223890:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048501.223990:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111345024 00000100:00100000:2.0:1789048501.224000:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111345024 00000100:00100000:2.0:1789048501.224061:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789048501.224088:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0822aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111345024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789048501.224145:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789048501.224199:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0822aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111345024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048501.224207:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789048501.224262:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111345024:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789048501.225551:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048501.726867:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08205c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111345152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789048501.726958:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048501.727047:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111345280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789048501.727070:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048501.727320:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111345152 00000100:00100000:1.0:1789048501.727330:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111345152 00000100:00100000:1.0:1789048501.727403:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111345280 00000100:00100000:1.0:1789048501.727406:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111345280 00000100:00100000:1.0:1789048501.727422:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789048501.727430:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08204000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111345152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789048501.727470:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048501.727538:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08204000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111345152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048501.727546:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789048501.727563:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789048501.727569:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111345280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789048501.727577:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048501.727598:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111345280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 29us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048501.727603:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1789048501.727642:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08205c00 x1875953111345152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048501.727661:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08205c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111345152:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789048501.732293:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08207b80 x1875953111345280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048501.732356:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111345280:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789048502.239691:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048502.750688:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789048502.750712:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111345408:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048502.750783:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048502.750933:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111345408 00000100:00100000:2.0:1789048502.750941:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111345408 00000100:00100000:2.0:1789048502.750997:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789048502.751006:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111345408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789048502.751041:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789048502.751153:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111345408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 147us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048502.751160:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789048502.754440:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111345408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048502.858981:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048502.859024:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048502.859044:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048502.859065:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048502.859092:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048502.859131:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097646848 00000100:00100000:0.0:1789048502.859142:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097646848 00000100:00100000:0.0:1789048502.859208:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097646720 00000100:00100000:0.0:1789048502.859212:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097646720 00000100:00100000:0.0:1789048502.859235:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 91 00000100:00100000:0.0:1789048502.859247:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2392:x1875953097646848:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048502.859325:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2392:x1875953097646848:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 81us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048502.859366:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 91 00000100:00100000:0.0:1789048502.859384:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 92 00000100:00100000:0.0:1789048502.860186:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2392:x1875953097646720:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048502.860248:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2392:x1875953097646720:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 857us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048502.860256:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 92 00000100:00100000:2.0:1789048502.860814:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097646592 00000100:00100000:2.0:1789048502.860823:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097646592 00000100:00100000:2.0:1789048502.860865:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 282 00000100:00100000:2.0:1789048502.860874:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2392:x1875953097646592:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048502.860911:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2392:x1875953097646592:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 39us (1941us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048502.860918:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 282 00000100:00100000:2.0:1789048502.860954:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097646976 00000100:00100000:2.0:1789048502.860958:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097646976 00000100:00100000:2.0:1789048502.860995:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097647104 00000100:00100000:2.0:1789048502.860999:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097647104 00000100:00100000:2.0:1789048502.861041:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:2.0:1789048502.861049:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08207b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2390:x1875953097646976:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:2.0:1789048502.861081:0:8414:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775dec 00000100:00080000:2.0:1789048502.861092:0:8414:0:(import.c:65:import_set_state_nolock()) ffff959b08028000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789048502.861151:0:8414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789048502.861282:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08207b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+2:2390:x1875953097646976:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 234us (2257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048502.861290:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:2.0:1789048502.861304:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:2.0:1789048502.861311:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08207480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2390:x1875953097647104:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:2.0:1789048502.861325:0:8414:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775df3 00000100:00080000:2.0:1789048502.861355:0:8414:0:(import.c:65:import_set_state_nolock()) ffff959b0758c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789048502.861378:0:8414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789048502.861462:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08207480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+2:2390:x1875953097647104:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 151us (2416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048502.861469:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00080000:2.0:1789048502.861491:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789048502.861495:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789048502.861498:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789048502.861500:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789048502.861567:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048502.861572:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048503.262275:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048504.289910:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789048504.458820:0:10918:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing yml_node 00010000:00010000:0.0:1789048505.312019:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048505.821787:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789048505.821815:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111345536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789048505.821893:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048505.821971:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111345536 00000100:00100000:1.0:1789048505.821980:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111345536 00000100:00100000:1.0:1789048505.822038:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789048505.822050:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111345536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789048505.822093:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048505.822138:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111345536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048505.822145:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1789048505.822184:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789048505.822279:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08109c00 x1875953111345536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048505.822298:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111345536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048505.822819:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111346048:0@lo:400:kworker.0 00000100:00100000:3.0:1789048505.822859:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048505.822882:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111346560:0@lo:400:kworker.0 00000100:00100000:3.0:1789048505.822909:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048505.822929:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111347072:0@lo:400:kworker.0 00000100:00100000:3.0:1789048505.822949:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048505.822968:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789048505.822973:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0822b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111345664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048505.822995:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048505.823033:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111346176:0@lo:400:kworker.0 00000100:00100000:3.0:1789048505.823056:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048505.823092:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111346688:0@lo:400:kworker.0 00000100:00100000:3.0:1789048505.823127:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048505.823146:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111347200:0@lo:400:kworker.0 00000100:00100000:3.0:1789048505.823167:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048505.823192:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111346048 00000100:00100000:3.0:1789048505.823198:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111346048 00000100:00100000:3.0:1789048505.823232:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789048505.823238:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111346048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048505.823281:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111346048:12345-0@lo:400:kworker.0 Request processed in 43us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048505.823288:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789048505.823308:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111346560 00000100:00100000:3.0:1789048505.823313:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111346560 00000100:00100000:3.0:1789048505.823369:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111347072 00000100:00100000:3.0:1789048505.823373:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111347072 00000100:00100000:3.0:1789048505.823388:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111346176 00000100:00100000:3.0:1789048505.823391:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111346176 00000100:00100000:3.0:1789048505.823419:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789048505.823425:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111346560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048505.823457:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111346560:12345-0@lo:400:kworker.0 Request processed in 32us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048505.823463:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789048505.823475:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789048505.823481:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111347072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048505.823507:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111347072:12345-0@lo:400:kworker.0 Request processed in 27us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048505.823520:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789048505.823532:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789048505.823538:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111346176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048505.823568:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111346176:12345-0@lo:400:kworker.0 Request processed in 31us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048505.823573:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789048505.823594:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111345664 00000100:00100000:3.0:1789048505.823598:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111345664 00000100:00100000:3.0:1789048505.823619:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789048505.823625:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111345664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789048505.823638:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048505.823666:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111345664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048505.823673:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789048505.823694:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111346688 00000100:00100000:3.0:1789048505.823698:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111346688 00000100:00100000:3.0:1789048505.823721:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111347200 00000100:00100000:3.0:1789048505.823724:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111347200 00000100:00100000:3.0:1789048505.823739:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789048505.823745:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111346688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048505.823773:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111346688:12345-0@lo:400:kworker.0 Request processed in 29us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048505.823779:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789048505.823790:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789048505.823796:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2ecbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111347200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048505.823822:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2ecbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111347200:12345-0@lo:400:kworker.0 Request processed in 27us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048505.823835:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1789048505.824018:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0822b480 x1875953111345664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048505.824034:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0822b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111345664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048505.824046:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111346176:0@lo:400:kworker.0 00010000:00080000:3.0:1789048505.824056:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0820ea00 x1875953111346688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048505.824064:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111346688:0@lo:400:kworker.0 00010000:00080000:3.0:1789048505.824087:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0820ca80 x1875953111347200/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048505.824095:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111347200:0@lo:400:kworker.0 00000100:00100000:3.0:1789048505.824104:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111346048:0@lo:400:kworker.0 00010000:00080000:3.0:1789048505.824113:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0820c000 x1875953111346560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048505.824121:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111346560:0@lo:400:kworker.0 00010000:00080000:3.0:1789048505.824130:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0820f100 x1875953111347072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048505.824137:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111347072:0@lo:400:kworker.0 00000100:00100000:1.0:1789048505.825241:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111345792:0@lo:400:kworker.0 00000100:00100000:1.0:1789048505.825295:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048505.825380:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111346304:0@lo:400:kworker.0 00000100:00100000:1.0:1789048505.825418:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048505.825436:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111346816:0@lo:400:kworker.0 00000100:00100000:1.0:1789048505.825456:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048505.825480:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789048505.825487:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111345920:0@lo:400:kworker.0 00000100:00100000:1.0:1789048505.825510:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048505.825528:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111346432:0@lo:400:kworker.0 00000100:00100000:1.0:1789048505.825548:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048505.825566:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111346944:0@lo:400:kworker.0 00000100:00100000:1.0:1789048505.825585:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048505.825623:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111345920 00000100:00100000:1.0:1789048505.825630:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111345920 00000100:00100000:1.0:1789048505.825666:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111346432 00000100:00100000:1.0:1789048505.825669:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111346432 00000100:00100000:1.0:1789048505.825687:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111346944 00000100:00100000:1.0:1789048505.825689:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111346944 00000100:00100000:1.0:1789048505.825704:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789048505.825712:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111345920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048505.825760:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111345920:12345-0@lo:400:kworker.0 Request processed in 47us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048505.825779:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789048505.825798:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789048505.825804:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111346432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048505.825834:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111346432:12345-0@lo:400:kworker.0 Request processed in 31us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048505.825840:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789048505.825853:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789048505.825858:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111346944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048505.825889:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111346944:12345-0@lo:400:kworker.0 Request processed in 30us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048505.825893:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1789048505.825915:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789048505.825921:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789048505.825923:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789048505.825925:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789048505.825946:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111346816 00000100:00100000:1.0:1789048505.825950:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111346816 00000100:00100000:1.0:1789048505.825980:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789048505.825986:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111346816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048505.826015:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111346816:12345-0@lo:400:kworker.0 Request processed in 29us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048505.826020:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1789048505.826038:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789048505.826061:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111345920:0@lo:400:kworker.0 00000100:00100000:1.0:1789048505.826086:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111346432:0@lo:400:kworker.0 00000100:00100000:1.0:1789048505.826108:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111346944:0@lo:400:kworker.0 00010000:00080000:1.0:1789048505.826129:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0820f480 x1875953111346816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048505.826137:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111346816:0@lo:400:kworker.0 00000100:00100000:2.0:1789048505.832216:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111345792 00000100:00100000:2.0:1789048505.832230:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111345792 00000100:00100000:2.0:1789048505.832289:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789048505.832296:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111345792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048505.832418:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111345792:12345-0@lo:400:kworker.0 Request processed in 121us (7122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048505.832425:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789048505.832484:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111345792:0@lo:400:kworker.0 00000100:00100000:3.0:1789048505.832604:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111346304 00000100:00100000:3.0:1789048505.832609:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111346304 00000100:00100000:3.0:1789048505.832638:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789048505.832643:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111346304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048505.832690:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111346304:12345-0@lo:400:kworker.0 Request processed in 45us (7270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048505.832696:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789048505.832765:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111346304:0@lo:400:kworker.0 00000100:00100000:3.0:1789048505.920747:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048505.921572:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097647360 00000100:00100000:1.0:1789048505.921583:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097647360 00000100:00100000:1.0:1789048505.921668:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 99 00000100:00100000:1.0:1789048505.921679:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097647360:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048505.921764:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097647360:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 87us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048505.921771:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 99 00000100:00080000:2.0:1789048505.921939:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789048505.937994:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048505.938043:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048505.938119:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097647488 00000100:00100000:1.0:1789048505.938128:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097647488 00000100:00100000:1.0:1789048505.938201:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 100 00000100:00100000:1.0:1789048505.938212:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08204a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097647488:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048505.938290:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08204a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097647488:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 80us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048505.938299:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 100 00000100:00100000:3.0:1789048505.938431:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097647232 00000100:00100000:3.0:1789048505.938437:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097647232 00000100:00100000:3.0:1789048505.938476:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 284 00000100:00100000:3.0:1789048505.938484:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2393:x1875953097647232:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048505.938513:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2393:x1875953097647232:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 30us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048505.938520:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 284 00000100:00080000:0.0:1789048505.938755:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789048506.334801:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1789048506.335096:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048506.338044:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111347328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048506.338321:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048506.338697:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111347328 00000100:00100000:3.0:1789048506.338707:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111347328 00000100:00100000:3.0:1789048506.338812:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789048506.338824:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111347328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789048506.338862:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789048506.338923:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111347328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048506.338930:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789048506.339022:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111347328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048506.845682:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08206680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111347456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789048506.845765:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048506.846048:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111347456 00000100:00100000:3.0:1789048506.846067:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111347456 00000100:00100000:3.0:1789048506.846310:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789048506.846322:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111347456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789048506.846383:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048506.846442:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111347456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048506.846459:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1789048506.846535:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08206680 x1875953111347456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048506.846554:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08206680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111347456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789048506.847376:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08206300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111347584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789048506.847427:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048506.847984:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111347584 00000100:00100000:2.0:1789048506.847993:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111347584 00000100:00100000:2.0:1789048506.848031:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789048506.848250:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111347584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789048506.848273:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789048506.848447:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111347584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 201us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048506.848454:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1789048506.848546:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08206300 x1875953111347584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048506.848562:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08206300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111347584:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789048507.357908:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048507.870169:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789048507.872234:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111347712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048507.872314:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048507.872875:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111347712 00000100:00100000:2.0:1789048507.872884:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111347712 00000100:00100000:2.0:1789048507.873045:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789048507.873064:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111347712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789048507.873100:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789048507.873173:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111347712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048507.873181:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789048507.873262:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111347712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048507.968523:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048507.968573:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048507.968618:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048507.968773:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097647872 00000100:00100000:0.0:1789048507.968785:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097647872 00000100:00100000:0.0:1789048507.968849:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097647744 00000100:00100000:0.0:1789048507.968852:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097647744 00000100:00100000:0.0:1789048507.968873:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 101 00000100:00100000:0.0:1789048507.968885:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097647872:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048507.968961:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097647872:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 78us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048507.968969:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 101 00000100:00100000:0.0:1789048507.968986:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 102 00000100:00100000:0.0:1789048507.968994:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097647744:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048507.969018:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097647744:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048507.969024:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 102 00000100:00080000:1.0:1789048507.969389:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789048507.969393:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048507.969564:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097647616 00000100:00100000:3.0:1789048507.969570:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097647616 00000100:00100000:3.0:1789048507.969609:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 285 00000100:00100000:3.0:1789048507.969617:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2393:x1875953097647616:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048507.969660:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2393:x1875953097647616:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 43us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048507.969666:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 285 00010000:00010000:0.0:1789048508.385637:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789048508.385987:0:9492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 00000020:00000080:1.0:1789048508.385993:0:9492:0:(genops.c:885:class_export_put()) final put ffff959b08015800/85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 00000020:00000080:0.0:1789048508.386315:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b08015800/85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b for lustre-OST0001 00000020:00000080:0.0:1789048508.386431:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b0758c800 for lustre-OST0001 00000001:00100000:2.0:1789048508.388592:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 00000020:00000080:2.0:1789048508.388606:0:8407:0:(genops.c:885:class_export_put()) final put ffff959b08029800/85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 00000020:00000080:3.0:1789048508.388706:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959b08029800/85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b for lustre-OST0000 00000020:00000080:3.0:1789048508.388779:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b08028000 for lustre-OST0000 00010000:00010000:2.0:1789048509.405629:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789048510.003285:0:11102:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.40 00010000:00010000:2.0:1789048510.430275:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048510.941785:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111347840:0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.941865:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048510.941914:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111348352:0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.941939:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048510.941957:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111348864:0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.941979:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048510.941997:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111349376:0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.942029:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048510.942055:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789048510.942061:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111347968:0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.942087:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048510.942102:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111348480:0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.942121:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048510.942139:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111348992:0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.942175:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048510.942203:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111348096:0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.942225:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048510.942242:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111348608:0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.942263:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048510.942281:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111349120:0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.942300:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048510.942312:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789048510.942318:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111348224:0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.942411:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048510.942426:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111348736:0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.942446:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048510.942465:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111349248:0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.942484:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048510.942513:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111347840 00000100:00100000:3.0:1789048510.942520:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111347840 00000100:00100000:3.0:1789048510.942563:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789048510.942572:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111347840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.942621:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111347840:12345-0@lo:400:kworker.0 Request processed in 50us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048510.942628:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789048510.942662:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111348352 00000100:00100000:3.0:1789048510.942666:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111348352 00000100:00100000:3.0:1789048510.942691:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111348096 00000100:00100000:3.0:1789048510.942694:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111348096 00000100:00100000:3.0:1789048510.942707:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789048510.942720:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111348352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.942756:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111348352:12345-0@lo:400:kworker.0 Request processed in 37us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048510.942763:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789048510.942775:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789048510.942782:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111348096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.942814:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111348096:12345-0@lo:400:kworker.0 Request processed in 32us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048510.942820:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789048510.942839:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111348864 00000100:00100000:3.0:1789048510.942842:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111348864 00000100:00100000:3.0:1789048510.942870:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111349376 00000100:00100000:3.0:1789048510.942873:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111349376 00000100:00100000:3.0:1789048510.942884:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111348736 00000100:00100000:3.0:1789048510.942887:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111348736 00000100:00100000:3.0:1789048510.942899:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111349248 00000100:00100000:3.0:1789048510.942902:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111349248 00000100:00100000:3.0:1789048510.942917:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789048510.942924:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111348864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.942955:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111348864:12345-0@lo:400:kworker.0 Request processed in 31us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048510.942961:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789048510.942973:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789048510.942979:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111349376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.943006:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111349376:12345-0@lo:400:kworker.0 Request processed in 28us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048510.943011:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789048510.943042:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789048510.943048:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111348736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.943074:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111348736:12345-0@lo:400:kworker.0 Request processed in 27us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048510.943080:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789048510.943089:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789048510.943095:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111349248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.943116:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111349248:12345-0@lo:400:kworker.0 Request processed in 23us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048510.943122:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789048510.943142:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111347968 00000100:00100000:3.0:1789048510.943145:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111347968 00000100:00100000:3.0:1789048510.943162:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111348480 00000100:00100000:3.0:1789048510.943164:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111348480 00000100:00100000:3.0:1789048510.943175:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111348992 00000100:00100000:3.0:1789048510.943177:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111348992 00000100:00100000:3.0:1789048510.943187:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111348608 00000100:00100000:3.0:1789048510.943190:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111348608 00000100:00100000:3.0:1789048510.943201:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111349120 00000100:00100000:3.0:1789048510.943203:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111349120 00000100:00100000:3.0:1789048510.943214:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111348224 00000100:00100000:3.0:1789048510.943216:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111348224 00000100:00100000:3.0:1789048510.943227:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789048510.943233:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111347968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.943260:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111347968:12345-0@lo:400:kworker.0 Request processed in 27us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048510.943266:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789048510.943275:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789048510.943280:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111348480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.943315:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111348480:12345-0@lo:400:kworker.0 Request processed in 34us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048510.943321:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789048510.943360:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789048510.943368:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111348992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.943395:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111348992:12345-0@lo:400:kworker.0 Request processed in 29us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048510.943400:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789048510.943412:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789048510.943418:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111348608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.943446:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111348608:12345-0@lo:400:kworker.0 Request processed in 29us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048510.943452:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789048510.943463:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789048510.943468:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111349120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.943495:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111349120:12345-0@lo:400:kworker.0 Request processed in 27us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048510.943500:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789048510.943511:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789048510.943517:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111348224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.943541:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111348224:12345-0@lo:400:kworker.0 Request processed in 24us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048510.943546:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1789048510.943586:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789048510.943590:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048510.943599:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789048510.943602:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789048510.943634:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111348224:0@lo:400:kworker.0 00010000:00080000:3.0:1789048510.943648:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07bf3480 x1875953111348736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048510.943659:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111348736:0@lo:400:kworker.0 00010000:00080000:3.0:1789048510.943669:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07bf3100 x1875953111349248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048510.943677:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111349248:0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.943687:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111348096:0@lo:400:kworker.0 00010000:00080000:3.0:1789048510.943695:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c03e56300 x1875953111348608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048510.943702:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111348608:0@lo:400:kworker.0 00010000:00080000:3.0:1789048510.943710:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07bf0700 x1875953111349120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048510.943718:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111349120:0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.943757:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111347968:0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.943767:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111348480:0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.943776:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111348992:0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.943786:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111347840:0@lo:400:kworker.0 00000100:00100000:3.0:1789048510.943795:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111348352:0@lo:400:kworker.0 00010000:00080000:3.0:1789048510.943814:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07bf1c00 x1875953111348864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048510.943823:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111348864:0@lo:400:kworker.0 00010000:00080000:3.0:1789048510.943833:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07bf0000 x1875953111349376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048510.943840:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111349376:0@lo:400:kworker.0 00000100:00100000:0.0:1789048510.944539:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111349504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048510.944601:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048510.944750:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111349504 00000100:00100000:2.0:1789048510.944757:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111349504 00000100:00100000:2.0:1789048510.944806:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789048510.944816:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08206680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111349504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789048510.944841:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789048510.944881:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08206680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111349504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048510.944888:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1789048510.945586:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08228700 x1875953111349504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048510.945616:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111349504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048510.950573:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789048510.950606:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111349632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789048510.950684:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048510.950733:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111349632 00000100:00100000:0.0:1789048510.950741:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111349632 00000100:00100000:0.0:1789048510.950784:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789048510.950791:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08206300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111349632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789048510.950811:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048510.950849:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08206300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111349632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048510.950856:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1789048510.950891:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08204380 x1875953111349632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048510.950909:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111349632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789048511.453825:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789048511.453850:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111349760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048511.453935:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048511.454323:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111349760 00000100:00100000:3.0:1789048511.454365:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111349760 00000100:00100000:3.0:1789048511.454420:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789048511.454430:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111349760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789048511.454463:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789048511.454531:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111349760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048511.454538:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789048511.454670:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111349760:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789048511.455346:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048511.969124:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111349888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048511.969201:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048511.969437:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0822b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111350016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789048511.969468:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048511.969512:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111349888 00000100:00100000:0.0:1789048511.969532:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111349888 00000100:00100000:0.0:1789048511.969577:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111350016 00000100:00100000:0.0:1789048511.969581:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111350016 00000100:00100000:0.0:1789048511.969597:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789048511.969604:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111349888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789048511.969632:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048511.969940:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789048511.969952:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08207800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111350016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789048511.969964:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048511.970023:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08207800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111350016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048511.970037:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1789048511.970081:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0822b100 x1875953111350016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048511.970111:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0822b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111350016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789048511.979496:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111349888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9880us (10283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048511.979510:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1789048511.979676:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08204380 x1875953111349888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048511.979704:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111349888:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789048512.478021:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789048512.906052:0:11199:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.40 00000100:00100000:0.0:1789048512.993235:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111350144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048512.993315:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048512.993461:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111350144 00000100:00100000:2.0:1789048512.993469:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111350144 00000100:00100000:2.0:1789048512.993519:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789048512.993528:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111350144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789048512.993563:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789048512.999122:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111350144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5581us (5795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048512.999140:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789048512.999459:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111350144:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048513.086651:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048513.086696:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048513.086727:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048513.086795:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097648000 00000100:00100000:2.0:1789048513.086805:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097648000 00000100:00100000:2.0:1789048513.086862:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 287 00000100:00100000:2.0:1789048513.086871:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2394:x1875953097648000:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048513.086944:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2394:x1875953097648000:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 74us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048513.086952:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 287 00000100:00100000:3.0:1789048513.087178:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097648256 00000100:00100000:3.0:1789048513.087184:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097648256 00000100:00100000:3.0:1789048513.087238:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097648128 00000100:00100000:3.0:1789048513.087241:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097648128 00000100:00100000:3.0:1789048513.087265:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 109 00000100:00100000:3.0:1789048513.087273:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097648256:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048513.087319:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097648256:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 46us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048513.087326:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 109 00000100:00100000:3.0:1789048513.087368:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 110 00000100:00100000:3.0:1789048513.087375:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097648128:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048513.087398:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097648128:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 24us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048513.087404:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 110 00000100:00080000:1.0:1789048513.087555:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789048513.087560:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789048513.507326:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048514.527899:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048515.549715:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048516.066154:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111350272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789048516.066249:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048516.066378:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111350272 00000100:00100000:0.0:1789048516.066389:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111350272 00000100:00100000:0.0:1789048516.066457:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789048516.066471:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08207480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111350272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789048516.066509:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048516.066561:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08207480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111350272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048516.066568:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1789048516.066592:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789048516.067102:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08207b80 x1875953111350272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048516.067124:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111350272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048516.067438:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111350400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789048516.067487:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048516.067539:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111350400 00000100:00100000:2.0:1789048516.067544:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111350400 00000100:00100000:2.0:1789048516.067593:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789048516.067600:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0822a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111350400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789048516.067617:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789048516.067735:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0822a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111350400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048516.067743:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1789048516.067764:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789048516.067783:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08228a80 x1875953111350400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048516.067796:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111350400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048516.070238:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111350656:0@lo:400:kworker.0 00000100:00100000:3.0:1789048516.070361:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048516.070399:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111351168:0@lo:400:kworker.0 00000100:00100000:3.0:1789048516.070425:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048516.070441:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111351680:0@lo:400:kworker.0 00000100:00100000:3.0:1789048516.070462:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048516.070490:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789048516.070496:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111350784:0@lo:400:kworker.0 00000100:00100000:3.0:1789048516.070524:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048516.070575:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111351296:0@lo:400:kworker.0 00000100:00100000:3.0:1789048516.070600:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048516.070618:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111351808:0@lo:400:kworker.0 00000100:00100000:3.0:1789048516.070640:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048516.070678:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111350656 00000100:00100000:3.0:1789048516.070688:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111350656 00000100:00100000:3.0:1789048516.070739:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111351168 00000100:00100000:3.0:1789048516.070763:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111351168 00000100:00100000:3.0:1789048516.070793:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111351680 00000100:00100000:3.0:1789048516.070796:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111351680 00000100:00100000:3.0:1789048516.070809:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111351296 00000100:00100000:3.0:1789048516.070811:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111351296 00000100:00100000:3.0:1789048516.070825:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111351808 00000100:00100000:3.0:1789048516.070828:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111351808 00000100:00100000:3.0:1789048516.070846:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789048516.070858:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111350656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048516.070931:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111350656:12345-0@lo:400:kworker.0 Request processed in 74us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048516.070940:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789048516.070963:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789048516.070985:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111351168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048516.071020:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111351168:12345-0@lo:400:kworker.0 Request processed in 50us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048516.071026:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789048516.071040:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789048516.071046:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111351680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048516.071075:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111351680:12345-0@lo:400:kworker.0 Request processed in 29us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048516.071081:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789048516.071093:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789048516.071098:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111351296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048516.071122:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111351296:12345-0@lo:400:kworker.0 Request processed in 25us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048516.071127:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789048516.071147:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789048516.071154:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111351808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048516.071180:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111351808:12345-0@lo:400:kworker.0 Request processed in 27us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048516.071186:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789048516.071209:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111350784 00000100:00100000:3.0:1789048516.071213:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111350784 00000100:00100000:3.0:1789048516.071240:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789048516.071247:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111350784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048516.071277:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111350784:12345-0@lo:400:kworker.0 Request processed in 32us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048516.071283:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789048516.071472:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111350784:0@lo:400:kworker.0 00010000:00080000:3.0:1789048516.071489:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0820e300 x1875953111351296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048516.071499:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111351296:0@lo:400:kworker.0 00010000:00080000:3.0:1789048516.071508:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb4ca80 x1875953111351808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048516.071516:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111351808:0@lo:400:kworker.0 00000100:00100000:3.0:1789048516.071529:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111350656:0@lo:400:kworker.0 00000100:00100000:3.0:1789048516.071539:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111351168:0@lo:400:kworker.0 00000100:00100000:3.0:1789048516.071549:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111351680:0@lo:400:kworker.0 00000100:00100000:2.0:1789048516.074466:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111350528:0@lo:400:kworker.0 00000100:00100000:2.0:1789048516.074578:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048516.074660:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111351040:0@lo:400:kworker.0 00000100:00100000:2.0:1789048516.074692:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048516.074717:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111351552:0@lo:400:kworker.0 00000100:00100000:2.0:1789048516.074742:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048516.074774:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789048516.074782:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111350912:0@lo:400:kworker.0 00000100:00100000:2.0:1789048516.074807:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048516.074847:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111351424:0@lo:400:kworker.0 00000100:00100000:2.0:1789048516.074871:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048516.074915:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111350912 00000100:00100000:2.0:1789048516.074926:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111350912 00000100:00100000:2.0:1789048516.075124:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789048516.075136:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111350912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048516.075202:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111350912:12345-0@lo:400:kworker.0 Request processed in 69us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048516.075210:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1789048516.075239:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789048516.075245:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789048516.075261:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111351040 00000100:00100000:2.0:1789048516.075265:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111351040 00000100:00100000:2.0:1789048516.075294:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789048516.075301:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111351040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048516.075368:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111351040:12345-0@lo:400:kworker.0 Request processed in 67us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048516.075374:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789048516.075392:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111351552 00000100:00100000:2.0:1789048516.075396:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111351552 00000100:00100000:2.0:1789048516.075430:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111351424 00000100:00100000:2.0:1789048516.075433:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111351424 00000100:00100000:2.0:1789048516.075454:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789048516.075460:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0822a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111351552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048516.075491:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0822a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111351552:12345-0@lo:400:kworker.0 Request processed in 33us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048516.075497:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789048516.075508:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789048516.075522:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0822ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111351424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048516.075552:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0822ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111351424:12345-0@lo:400:kworker.0 Request processed in 31us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048516.075558:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789048516.075612:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111350912:0@lo:400:kworker.0 00010000:00080000:2.0:1789048516.075631:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0820df80 x1875953111351424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048516.075643:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111351424:0@lo:400:kworker.0 00000100:00100000:2.0:1789048516.075653:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111351040:0@lo:400:kworker.0 00010000:00080000:2.0:1789048516.075662:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0820c700 x1875953111351552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048516.075670:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111351552:0@lo:400:kworker.0 00000100:00080000:2.0:1789048516.075697:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789048516.082130:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111350528 00000100:00100000:0.0:1789048516.082154:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111350528 00000100:00100000:0.0:1789048516.082233:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789048516.082245:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3621:x1875953111350528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048516.082394:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3621:x1875953111350528:12345-0@lo:400:kworker.0 Request processed in 151us (7816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048516.082403:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789048516.084265:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111350528:0@lo:400:kworker.0 00000001:02000400:1.0:1789048516.268488:0:11297:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.40 00000100:00100000:2.0:1789048516.579070:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111351936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048516.579139:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048516.579274:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111351936 00000100:00100000:0.0:1789048516.579282:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111351936 00000100:00100000:0.0:1789048516.579425:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789048516.579435:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0822b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111351936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789048516.579470:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789048516.579529:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0822b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111351936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048516.579767:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111351936:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789048516.583061:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048516.585652:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789048517.085764:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111352064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789048517.085840:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048517.088015:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111352192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048517.088111:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048517.092306:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111352064 00000100:00100000:0.0:1789048517.092321:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111352064 00000100:00100000:2.0:1789048517.092503:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111352192 00000100:00100000:2.0:1789048517.092508:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111352192 00000100:00100000:2.0:1789048517.092553:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789048517.092563:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111352064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789048517.092597:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789048517.092685:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111352064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (6845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048517.092711:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789048517.092729:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789048517.092736:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111352192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789048517.092758:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789048517.092798:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111352192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (4687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048517.092805:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1789048517.092852:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0747df80 x1875953111352192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048517.092872:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111352192:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789048517.093299:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08228700 x1875953111352064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048517.093315:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111352064:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789048517.602740:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789048517.938215:0:11345:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 10 09:55:17 EDT 2026 00000100:00100000:3.0:1789048518.111592:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111352320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048518.111663:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048518.116232:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111352320 00000100:00100000:2.0:1789048518.116249:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111352320 00000100:00100000:2.0:1789048518.116304:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789048518.116314:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111352320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789048518.116385:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789048518.116474:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111352320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 160us (4810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048518.116481:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789048518.116535:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111352320:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048518.211304:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048518.214219:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048518.214265:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048518.214363:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097648640 00000100:00100000:1.0:1789048518.214374:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097648640 00000100:00100000:1.0:1789048518.214432:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097648512 00000100:00100000:1.0:1789048518.214436:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097648512 00000100:00100000:1.0:1789048518.214458:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 117 00000100:00100000:1.0:1789048518.214468:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0822b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2391:x1875953097648640:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048518.214537:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0822b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2391:x1875953097648640:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 71us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048518.214557:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 117 00000100:00100000:1.0:1789048518.214575:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:1.0:1789048518.214582:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2391:x1875953097648512:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048518.214607:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2391:x1875953097648512:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048518.214613:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00080000:2.0:1789048518.214673:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789048518.214678:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048518.215095:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097648384 00000100:00100000:3.0:1789048518.215101:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097648384 00000100:00100000:3.0:1789048518.215176:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 289 00000100:00100000:3.0:1789048518.215184:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2391:x1875953097648384:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048518.216166:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2391:x1875953097648384:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 978us (4864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048518.216175:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 289 00010000:00010000:2.0:1789048518.625652:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048519.645499:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048520.671523:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048521.183466:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789048521.183490:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111352448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048521.183558:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048521.183896:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111352448 00000100:00100000:2.0:1789048521.183905:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111352448 00000100:00100000:2.0:1789048521.183981:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789048521.183991:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111352448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789048521.184022:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789048521.184084:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111352448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (525us total) trans 0 rc 0/0 00000100:00080000:3.0:1789048521.184091:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789048521.184092:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789048521.184248:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111352832:0@lo:400:kworker.0 00000100:00100000:1.0:1789048521.184383:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048521.184409:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111353344:0@lo:400:kworker.0 00000100:00100000:1.0:1789048521.184449:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048521.184467:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111353856:0@lo:400:kworker.0 00000100:00100000:2.0:1789048521.184479:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111352704:0@lo:400:kworker.0 00000100:00100000:1.0:1789048521.184487:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048521.184504:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048521.184519:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111352832 00000100:00100000:2.0:1789048521.184521:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111353216:0@lo:400:kworker.0 00000100:00100000:1.0:1789048521.184523:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111352832 00000100:00100000:2.0:1789048521.184540:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048521.184553:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111353728:0@lo:400:kworker.0 00000100:00100000:1.0:1789048521.184553:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789048521.184560:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111352832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048521.184572:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048521.184595:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111353344 00000100:00100000:1.0:1789048521.184598:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111352832:12345-0@lo:400:kworker.0 Request processed in 39us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048521.184599:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111353344 00000100:00100000:1.0:1789048521.184603:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789048521.184622:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111353856 00000100:00100000:1.0:1789048521.184623:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111352704 00000100:00100000:2.0:1789048521.184624:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111353856 00000100:00100000:1.0:1789048521.184632:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111352704 00000100:00100000:2.0:1789048521.184637:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111353216 00000100:00100000:2.0:1789048521.184639:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111353216 00000100:00100000:1.0:1789048521.184646:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111353728 00000100:00100000:1.0:1789048521.184648:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111353728 00000100:00100000:2.0:1789048521.184652:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789048521.184657:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111353344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048521.184660:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789048521.184664:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111353856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048521.184687:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111353344:12345-0@lo:400:kworker.0 Request processed in 30us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048521.184687:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111353856:12345-0@lo:400:kworker.0 Request processed in 22us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048521.184693:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789048521.184741:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111352960:0@lo:400:kworker.0 00000100:00100000:3.0:1789048521.184771:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048521.184784:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111353472:0@lo:400:kworker.0 00000100:00100000:3.0:1789048521.184804:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048521.184822:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111353984:0@lo:400:kworker.0 00000100:00100000:3.0:1789048521.184842:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048521.184866:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789048521.184872:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111352576:0@lo:400:kworker.0 00000100:00100000:3.0:1789048521.184897:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048521.184928:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111353088:0@lo:400:kworker.0 00000100:00100000:3.0:1789048521.184949:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048521.184966:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111353600:0@lo:400:kworker.0 00000100:00100000:3.0:1789048521.184997:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048521.185026:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789048521.185033:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08205c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111354112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048521.185056:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048521.185083:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111353472 00000100:00100000:3.0:1789048521.185087:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111353472 00000100:00100000:3.0:1789048521.185115:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111353984 00000100:00100000:3.0:1789048521.185119:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111353984 00000100:00100000:3.0:1789048521.185133:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111353600 00000100:00100000:3.0:1789048521.185134:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111353600 00000100:00100000:3.0:1789048521.185147:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789048521.185153:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111353472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048521.185188:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111353472:12345-0@lo:400:kworker.0 Request processed in 34us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048521.185194:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789048521.185206:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789048521.185211:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111353984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048521.185236:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111353984:12345-0@lo:400:kworker.0 Request processed in 25us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048521.185241:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789048521.185251:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789048521.185257:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111353600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048521.185280:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111353600:12345-0@lo:400:kworker.0 Request processed in 24us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048521.185286:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789048521.185305:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111352576 00000100:00100000:3.0:1789048521.185309:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111352576 00000100:00100000:3.0:1789048521.185357:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789048521.185363:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111352576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048521.185408:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111352576:12345-0@lo:400:kworker.0 Request processed in 45us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048521.185414:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789048521.185441:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111353088 00000100:00100000:3.0:1789048521.185445:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111353088 00000100:00100000:3.0:1789048521.185468:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789048521.185474:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111353088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048521.185503:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111353088:12345-0@lo:400:kworker.0 Request processed in 29us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048521.185508:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789048521.185529:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111354112 00000100:00100000:3.0:1789048521.185532:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111354112 00000100:00100000:3.0:1789048521.185554:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789048521.185560:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111354112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789048521.185573:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048521.185602:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111354112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048521.185608:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1789048521.185629:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789048521.185633:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789048521.185635:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048521.185637:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789048521.185667:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08205c00 x1875953111354112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048521.185686:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08205c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111354112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048521.185704:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111352576:0@lo:400:kworker.0 00000100:00100000:3.0:1789048521.185713:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111353088:0@lo:400:kworker.0 00010000:00080000:3.0:1789048521.185723:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb30a80 x1875953111353600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048521.185731:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111353600:0@lo:400:kworker.0 00010000:00080000:3.0:1789048521.185742:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb31c00 x1875953111353472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048521.185750:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111353472:0@lo:400:kworker.0 00010000:00080000:3.0:1789048521.185759:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb30000 x1875953111353984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048521.185767:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111353984:0@lo:400:kworker.0 00000100:00100000:1.0:1789048521.191788:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111352960 00000100:00100000:1.0:1789048521.191803:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111352960 00000100:00100000:2.0:1789048521.192467:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789048521.192497:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789048521.192518:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0822b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111352704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048521.192619:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0822b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111352704:12345-0@lo:400:kworker.0 Request processed in 104us (8114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048521.192627:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789048521.192673:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111352704:0@lo:400:kworker.0 00000100:00100000:2.0:1789048521.192711:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789048521.192718:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111353216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048521.192756:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111353216:12345-0@lo:400:kworker.0 Request processed in 39us (8215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048521.192763:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789048521.192786:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111353216:0@lo:400:kworker.0 00000100:00100000:2.0:1789048521.192804:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789048521.192812:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111353728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048521.192847:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111353728:12345-0@lo:400:kworker.0 Request processed in 36us (8274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048521.192852:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789048521.192875:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111353728:0@lo:400:kworker.0 00000100:00100000:1.0:1789048521.194403:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789048521.194416:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111352960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048521.194488:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111352960:12345-0@lo:400:kworker.0 Request processed in 75us (9715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048521.194494:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:1.0:1789048521.194558:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0747f800 x1875953111352448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048521.194580:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111352448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048521.194615:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111352832:0@lo:400:kworker.0 00010000:00080000:1.0:1789048521.194629:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb30e00 x1875953111353344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048521.194638:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111353344:0@lo:400:kworker.0 00010000:00080000:1.0:1789048521.194649:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb32a00 x1875953111353856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048521.194657:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111353856:0@lo:400:kworker.0 00000100:00100000:1.0:1789048521.194694:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111352960:0@lo:400:kworker.0 00010000:00010000:2.0:1789048521.693565:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048521.693748:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08205880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111354240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048521.693820:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048521.694106:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111354240 00000100:00100000:3.0:1789048521.694114:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111354240 00000100:00100000:3.0:1789048521.694174:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789048521.694185:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111354240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789048521.694221:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789048521.694276:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111354240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048521.694283:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789048521.694373:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08205880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111354240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789048522.206066:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111354368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048522.206146:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048522.206274:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111354368 00000100:00100000:0.0:1789048522.206283:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111354368 00000100:00100000:0.0:1789048522.206378:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789048522.206389:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111354368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789048522.206418:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048522.206530:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111354496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789048522.206560:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048522.206609:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111354496 00000100:00100000:1.0:1789048522.206612:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111354496 00000100:00100000:1.0:1789048522.206651:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789048522.206656:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111354496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789048522.206667:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048522.206695:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111354496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048522.206701:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1789048522.206734:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb32a00 x1875953111354496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048522.206750:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111354496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789048522.213662:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111354368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7265us (7505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048522.213678:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1789048522.215213:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c08a8f800 x1875953111354368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048522.215324:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111354368:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789048522.717582:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048523.244942:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789048523.244971:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111354624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048523.245086:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048523.245145:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111354624 00000100:00100000:1.0:1789048523.245152:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111354624 00000100:00100000:1.0:1789048523.245199:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789048523.245208:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2acb8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111354624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789048523.245243:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789048523.245293:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2acb8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111354624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048523.245312:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789048523.245658:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111354624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789048523.325487:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048523.325541:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048523.325570:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097648896 00000100:00100000:3.0:1789048523.325582:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097648896 00000100:00100000:2.0:1789048523.325586:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048523.325616:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097649024 00000100:00100000:2.0:1789048523.325621:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097649024 00000100:00100000:3.0:1789048523.325659:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 125 00000100:00100000:3.0:1789048523.325671:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2391:x1875953097648896:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048523.325710:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097648768 00000100:00100000:0.0:1789048523.325716:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097648768 00000100:00100000:3.0:1789048523.325753:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2391:x1875953097648896:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 85us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048523.325761:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 291 00000100:00100000:0.0:1789048523.325776:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2391:x1875953097648768:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048523.325808:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2391:x1875953097648768:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 39us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048523.325814:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 291 00000100:00100000:2.0:1789048523.329609:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 126 00000100:00100000:2.0:1789048523.329631:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2391:x1875953097649024:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048523.329709:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2391:x1875953097649024:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 87us (4125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048523.329717:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 126 00000100:00080000:2.0:1789048523.336125:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789048523.336135:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048523.338253:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 125 00010000:00010000:2.0:1789048523.741662:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048524.766561:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048525.789929:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048526.306117:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111354752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048526.306218:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048526.307540:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111354880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048526.307614:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048526.307960:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08204e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111355008:0@lo:400:kworker.0 00000100:00100000:0.0:1789048526.308086:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048526.309791:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08205880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111355136:0@lo:400:kworker.0 00000100:00100000:3.0:1789048526.310635:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08205c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111355264:0@lo:400:kworker.0 00000100:00100000:3.0:1789048526.310687:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048526.310728:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111355776:0@lo:400:kworker.0 00000100:00100000:3.0:1789048526.310775:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111354752 00000100:00100000:3.0:1789048526.310785:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111354752 00000100:00100000:3.0:1789048526.310853:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111354880 00000100:00100000:3.0:1789048526.310857:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111354880 00000100:00100000:3.0:1789048526.310896:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789048526.310905:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111354752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789048526.310944:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048526.311366:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048526.311423:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111354752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 517us (5204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048526.311431:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789048526.311454:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789048526.311477:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111354880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789048526.311489:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048526.313714:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111355648:0@lo:400:kworker.0 00000100:00100000:1.0:1789048526.313795:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048526.313841:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875953111356160:0@lo:400:kworker.0 00000100:00100000:1.0:1789048526.313864:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048526.313939:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111355136 00000100:00100000:1.0:1789048526.313949:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111355136 00000100:00100000:1.0:1789048526.314259:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111355648 00000100:00100000:1.0:1789048526.314263:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111355648 00000100:00100000:1.0:1789048526.314300:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111356160 00000100:00100000:1.0:1789048526.314304:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111356160 00000100:00100000:1.0:1789048526.314353:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789048526.314364:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111355136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048526.314447:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111355136:12345-0@lo:400:kworker.0 Request processed in 84us (4579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048526.314454:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789048526.314473:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789048526.314479:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111355648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048526.314508:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111355648:12345-0@lo:400:kworker.0 Request processed in 29us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048526.314514:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789048526.314545:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789048526.314551:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875953111356160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048526.314583:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875953111356160:12345-0@lo:400:kworker.0 Request processed in 33us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048526.314589:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789048526.314641:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08205880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111355136:0@lo:400:kworker.0 00000100:00100000:1.0:1789048526.314654:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111355648:0@lo:400:kworker.0 00000100:00100000:1.0:1789048526.314664:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875953111356160:0@lo:400:kworker.0 00000100:00100000:2.0:1789048526.315089:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111355392:0@lo:400:kworker.0 00000100:00100000:2.0:1789048526.315171:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048526.315224:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111355904:0@lo:400:kworker.0 00000100:00100000:2.0:1789048526.315261:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048526.315682:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111354880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4200us (8062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048526.315696:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789048526.315741:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111355008 00000100:00100000:3.0:1789048526.315750:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111355008 00000100:00100000:3.0:1789048526.315801:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789048526.315813:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111355008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048526.315864:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111355008:12345-0@lo:400:kworker.0 Request processed in 56us (7778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048526.315881:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789048526.315924:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111355264 00000100:00100000:3.0:1789048526.315929:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111355264 00000100:00100000:3.0:1789048526.315973:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1789048526.315976:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048526.315982:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111355264:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789048526.315985:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789048526.316575:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111355264:12345-0@lo:400:kworker.0 Request processed in 594us (5886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048526.316585:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789048526.316614:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048526.316667:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111356288:0@lo:400:kworker.0 00000100:00100000:3.0:1789048526.316699:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789048526.316734:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0820ca80 x1875953111354752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048526.316760:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111354752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048526.316795:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08205c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111355264:0@lo:400:kworker.0 00000100:00100000:3.0:1789048526.316838:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111355392 00000100:00100000:3.0:1789048526.316843:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111355392 00000100:00100000:3.0:1789048526.316878:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111355776 00000100:00100000:3.0:1789048526.316881:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111355776 00000100:00100000:3.0:1789048526.316910:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111356288 00000100:00100000:3.0:1789048526.316913:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111356288 00000100:00100000:3.0:1789048526.316931:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789048526.316938:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111355392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048526.316974:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111355392:12345-0@lo:400:kworker.0 Request processed in 37us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048526.316981:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789048526.317276:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08204e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111355008:0@lo:400:kworker.0 00000100:00100000:0.0:1789048526.317491:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111355520:0@lo:400:kworker.0 00000100:00100000:0.0:1789048526.317535:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048526.317563:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111356032:0@lo:400:kworker.0 00000100:00100000:0.0:1789048526.317588:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048526.317756:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111355520 00000100:00100000:0.0:1789048526.317762:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111355520 00000100:00100000:0.0:1789048526.317799:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789048526.317807:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111355520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048526.317852:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111355520:12345-0@lo:400:kworker.0 Request processed in 46us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048526.317859:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789048526.317899:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111355520:0@lo:400:kworker.0 00000100:00100000:3.0:1789048526.325363:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789048526.325424:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111355776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048526.325491:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789048526.325521:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111356288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048526.325568:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111355776:12345-0@lo:400:kworker.0 Request processed in 174us (8951us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048526.325578:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789048526.325647:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111355904 00000100:00100000:3.0:1789048526.325656:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111355904 00000100:00100000:3.0:1789048526.325707:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111356032 00000100:00100000:3.0:1789048526.325711:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111356032 00000100:00100000:3.0:1789048526.325734:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789048526.325742:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111355904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048526.330749:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111355904:12345-0@lo:400:kworker.0 Request processed in 4991us (15471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048526.330769:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789048526.330821:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789048526.330843:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111356032:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789048526.331197:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d74700 x1875953111356032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048526.331216:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111356032:0@lo:400:kworker.0 00000100:00100000:3.0:1789048526.332138:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111356032:12345-0@lo:400:kworker.0 Request processed in 164us (13405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048526.332150:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1789048526.332202:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789048526.332209:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789048526.332257:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d76300 x1875953111355776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048526.332272:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111355776:0@lo:400:kworker.0 00010000:00080000:3.0:1789048526.333380:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d74a80 x1875953111356288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048526.333399:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111356288:0@lo:400:kworker.0 00000100:00100000:3.0:1789048526.333569:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111355392:0@lo:400:kworker.0 00010000:00080000:3.0:1789048526.333586:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d77b80 x1875953111355904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048526.333595:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111355904:0@lo:400:kworker.0 00010000:00080000:3.0:1789048526.333610:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c08a8f480 x1875953111354880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048526.333633:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111354880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048526.340135:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111356288:12345-0@lo:400:kworker.0 Request processed in 14620us (23424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048526.340151:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789048526.813648:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789048526.813684:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111356416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048526.813779:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048526.814289:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111356416 00000100:00100000:0.0:1789048526.814301:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111356416 00000100:00100000:0.0:1789048526.814403:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789048526.814415:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111356416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789048526.814480:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789048526.815053:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111356416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 638us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048526.815063:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00010000:1.0:1789048526.815947:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048526.816402:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111356416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789048527.325472:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111356544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048527.325548:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048527.325626:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111356544 00000100:00100000:3.0:1789048527.325635:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111356544 00000100:00100000:3.0:1789048527.325681:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789048527.325697:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111356544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789048527.325730:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048527.325776:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111356544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048527.325783:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1789048527.325825:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0820ca80 x1875953111356544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048527.325842:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111356544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048527.326237:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111356672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048527.326267:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048527.326359:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111356672 00000100:00100000:0.0:1789048527.326364:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111356672 00000100:00100000:0.0:1789048527.326395:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789048527.326402:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111356672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789048527.326413:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048527.326588:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111356672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 185us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048527.326595:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1789048527.327221:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d75880 x1875953111356672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048527.327241:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111356672:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789048527.843228:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048528.350675:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111356800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789048528.350756:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048528.350836:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111356800 00000100:00100000:2.0:1789048528.350843:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111356800 00000100:00100000:2.0:1789048528.350900:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789048528.350909:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111356800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789048528.350947:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789048528.350995:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111356800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048528.351003:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789048528.351054:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111356800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789048528.450757:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048528.450807:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048528.450840:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048528.450881:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097649280 00000100:00100000:2.0:1789048528.450891:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097649280 00000100:00100000:2.0:1789048528.450952:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097649408 00000100:00100000:2.0:1789048528.450956:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097649408 00000100:00100000:2.0:1789048528.450980:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 133 00000100:00100000:2.0:1789048528.450989:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097649280:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048528.451070:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097649280:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 81us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048528.451077:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 133 00000100:00100000:2.0:1789048528.451096:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 134 00000100:00100000:2.0:1789048528.451102:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097649408:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048528.451147:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097649408:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 45us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048528.451154:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 134 00000100:00080000:2.0:1789048528.451172:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789048528.451177:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789048528.451394:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097649152 00000100:00100000:0.0:1789048528.451400:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097649152 00000100:00100000:0.0:1789048528.451434:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 293 00000100:00100000:0.0:1789048528.451441:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2394:x1875953097649152:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048528.451477:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2394:x1875953097649152:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 37us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048528.451483:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 293 00010000:00010000:2.0:1789048528.865996:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048529.894137:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048530.929382:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048531.427380:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111356928:0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.427446:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048531.427491:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111357440:0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.427537:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048531.427572:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111357952:0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.427594:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048531.427623:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111358464:0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.427646:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048531.427685:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789048531.427692:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111357312:0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.427728:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048531.427748:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111357824:0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.427768:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048531.427783:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111358336:0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.427815:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048531.427852:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111357056:0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.427874:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048531.427906:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111357568:0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.427928:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048531.427944:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111358080:0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.427963:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048531.427978:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789048531.427984:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111357184:0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.428004:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048531.428018:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111357696:0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.428045:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048531.428058:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111358208:0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.428077:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048531.428104:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111356928 00000100:00100000:0.0:1789048531.428111:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111356928 00000100:00100000:0.0:1789048531.428156:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1789048531.428171:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3623:x1875953111356928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.428219:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3623:x1875953111356928:12345-0@lo:400:kworker.0 Request processed in 49us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048531.428226:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1789048531.428259:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111357440 00000100:00100000:0.0:1789048531.428263:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111357440 00000100:00100000:0.0:1789048531.428287:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111357184 00000100:00100000:0.0:1789048531.428290:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111357184 00000100:00100000:0.0:1789048531.428304:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789048531.428310:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111357440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.428371:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111357440:12345-0@lo:400:kworker.0 Request processed in 61us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048531.428378:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789048531.428390:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789048531.428396:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111357184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.428426:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111357184:12345-0@lo:400:kworker.0 Request processed in 30us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048531.428432:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789048531.428447:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111357952 00000100:00100000:0.0:1789048531.428450:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111357952 00000100:00100000:0.0:1789048531.428476:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111358464 00000100:00100000:0.0:1789048531.428479:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111358464 00000100:00100000:0.0:1789048531.428488:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111357824 00000100:00100000:0.0:1789048531.428490:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111357824 00000100:00100000:0.0:1789048531.428501:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111358336 00000100:00100000:0.0:1789048531.428503:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111358336 00000100:00100000:0.0:1789048531.428515:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789048531.428521:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111357952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.428560:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111357952:12345-0@lo:400:kworker.0 Request processed in 39us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048531.428566:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789048531.428579:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789048531.428585:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111358464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.428611:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111358464:12345-0@lo:400:kworker.0 Request processed in 27us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048531.428617:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789048531.428627:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789048531.428633:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111357824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.428657:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111357824:12345-0@lo:400:kworker.0 Request processed in 25us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048531.428663:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789048531.428674:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789048531.428680:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111358336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.428703:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111358336:12345-0@lo:400:kworker.0 Request processed in 25us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048531.428709:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789048531.428737:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111357312 00000100:00100000:0.0:1789048531.428741:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111357312 00000100:00100000:0.0:1789048531.428758:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111357056 00000100:00100000:0.0:1789048531.428761:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111357056 00000100:00100000:0.0:1789048531.428771:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111357568 00000100:00100000:0.0:1789048531.428773:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111357568 00000100:00100000:0.0:1789048531.428785:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111358080 00000100:00100000:0.0:1789048531.428787:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111358080 00000100:00100000:0.0:1789048531.428798:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111357696 00000100:00100000:0.0:1789048531.428807:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111357696 00000100:00100000:0.0:1789048531.428834:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111358208 00000100:00100000:0.0:1789048531.428837:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111358208 00000100:00100000:0.0:1789048531.428850:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789048531.428855:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111357312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.428885:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111357312:12345-0@lo:400:kworker.0 Request processed in 30us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048531.428891:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789048531.428902:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789048531.428908:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111357056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.428935:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111357056:12345-0@lo:400:kworker.0 Request processed in 27us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048531.428940:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789048531.428951:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789048531.428956:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111357568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.428980:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111357568:12345-0@lo:400:kworker.0 Request processed in 24us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048531.428985:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789048531.428996:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789048531.429001:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111358080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.429024:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111358080:12345-0@lo:400:kworker.0 Request processed in 24us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048531.429029:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789048531.429039:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789048531.429044:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111357696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.429067:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111357696:12345-0@lo:400:kworker.0 Request processed in 23us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048531.429080:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789048531.429091:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789048531.429096:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111358208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.429122:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111358208:12345-0@lo:400:kworker.0 Request processed in 26us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048531.429128:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789048531.429170:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111357312:0@lo:400:kworker.0 00010000:00080000:0.0:1789048531.429183:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080d8700 x1875953111357824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048531.429193:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111357824:0@lo:400:kworker.0 00010000:00080000:0.0:1789048531.429203:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080da300 x1875953111358336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048531.429210:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111358336:0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.429219:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111356928:0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.429228:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111357440:0@lo:400:kworker.0 00010000:00080000:0.0:1789048531.429237:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080db100 x1875953111357952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048531.429244:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111357952:0@lo:400:kworker.0 00010000:00080000:0.0:1789048531.429253:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080d8380 x1875953111358464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048531.429261:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111358464:0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.429317:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111357184:0@lo:400:kworker.0 00010000:00080000:0.0:1789048531.429327:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080db480 x1875953111357696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048531.429363:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111357696:0@lo:400:kworker.0 00010000:00080000:0.0:1789048531.429373:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080da680 x1875953111358208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048531.429381:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111358208:0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.429390:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111357056:0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.429398:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111357568:0@lo:400:kworker.0 00000100:00100000:0.0:1789048531.429406:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111358080:0@lo:400:kworker.0 00000100:00080000:2.0:1789048531.438934:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789048531.438945:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789048531.438948:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789048531.438950:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789048531.442064:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111358592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048531.442132:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048531.442186:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789048531.442193:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111358720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789048531.442216:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048531.442253:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111358592 00000100:00100000:0.0:1789048531.442260:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111358592 00000100:00100000:0.0:1789048531.442303:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111358720 00000100:00100000:0.0:1789048531.442306:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111358720 00000100:00100000:0.0:1789048531.442323:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789048531.442358:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111358592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789048531.442390:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048531.442433:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111358592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048531.442452:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789048531.442472:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789048531.442478:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111358720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789048531.442488:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048531.442514:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111358720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048531.442519:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1789048531.443699:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08092d80 x1875953111358720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048531.443724:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111358720:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789048531.443738:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0820e680 x1875953111358592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048531.443750:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111358592:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789048531.933898:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048531.935090:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789048531.935116:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111358848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048531.935787:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048531.935976:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111358848 00000100:00100000:0.0:1789048531.935987:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111358848 00000100:00100000:0.0:1789048531.936037:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789048531.936047:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111358848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789048531.936086:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789048531.936132:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111358848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048531.936139:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789048531.936937:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111358848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048532.450591:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789048532.450636:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111358976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048532.450783:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048532.451121:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789048532.451133:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111359104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789048532.451165:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048532.451212:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111358976 00000100:00100000:0.0:1789048532.451219:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111358976 00000100:00100000:0.0:1789048532.451260:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111359104 00000100:00100000:0.0:1789048532.451263:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111359104 00000100:00100000:0.0:1789048532.451279:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789048532.451287:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111358976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789048532.451370:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048532.451412:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111358976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048532.451418:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789048532.451435:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789048532.451441:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111359104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789048532.451451:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048532.451477:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111359104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048532.451483:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1789048532.451521:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08093800 x1875953111359104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048532.451554:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111359104:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789048532.451588:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0820f100 x1875953111358976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048532.451612:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111358976:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789048532.957569:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048533.470373:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111359232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048533.470459:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048533.471204:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111359232 00000100:00100000:3.0:1789048533.471217:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111359232 00000100:00100000:3.0:1789048533.471285:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789048533.471297:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111359232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789048533.471363:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789048533.471443:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111359232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 147us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048533.471449:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789048533.471656:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111359232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789048533.568430:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048533.568476:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048533.568504:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048533.568538:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097649792 00000100:00100000:2.0:1789048533.568547:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097649792 00000100:00100000:2.0:1789048533.568605:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097649664 00000100:00100000:2.0:1789048533.568608:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097649664 00000100:00100000:2.0:1789048533.568631:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00100000:2.0:1789048533.568640:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2391:x1875953097649792:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048533.568710:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2391:x1875953097649792:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 70us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048533.568716:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00100000:2.0:1789048533.568733:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 142 00000100:00100000:2.0:1789048533.568740:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2391:x1875953097649664:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048533.568776:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2391:x1875953097649664:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 37us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048533.568783:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 142 00000100:00080000:2.0:1789048533.568811:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789048533.568815:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048533.569613:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097649536 00000100:00100000:3.0:1789048533.569627:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097649536 00000100:00100000:3.0:1789048533.569701:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 295 00000100:00100000:3.0:1789048533.569712:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2391:x1875953097649536:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048533.569830:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2391:x1875953097649536:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 118us (1409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048533.569839:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 295 00010000:00010000:3.0:1789048533.988020:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789048534.265927:0:11974:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 09:55:33 (1789048533) === 00000100:00100000:2.0:1789048534.711045:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048534.711146:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097649920 00000100:00100000:0.0:1789048534.711168:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097649920 00000100:00100000:0.0:1789048534.711252:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 296 00000100:00100000:0.0:1789048534.711262:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:8726:x1875953097649920:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789048534.711279:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048534.711297:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef39c00/0x133f221c08775ee1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29614 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048534.711324:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef39c00/0x133f221c08775ee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29614 expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048534.711375:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef39c00/0x133f221c08775ee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29614 expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048534.711384:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39c00, rc 0) 00000100:00100000:0.0:1789048534.711443:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+11:8726:x1875953097649920:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 182us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048534.711450:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 296 00000100:00100000:1.0:1789048534.718941:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048534.719127:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097650048 00000100:00100000:0.0:1789048534.719138:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097650048 00000100:00100000:0.0:1789048534.719217:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 297 00000100:00100000:0.0:1789048534.719227:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+11:8726:x1875953097650048:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789048534.719605:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+11:8726:x1875953097650048:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 378us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048534.719614:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 297 00000100:00100000:2.0:1789048534.737936:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048534.738200:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097650176 00000100:00100000:3.0:1789048534.738212:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097650176 00000100:00100000:3.0:1789048534.738279:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 298 00000100:00100000:3.0:1789048534.738289:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+11:8726:x1875953097650176:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789048534.738746:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+11:8726:x1875953097650176:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 456us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048534.738755:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 298 00000100:00100000:2.0:1789048534.746826:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048534.748167:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097650304 00000100:00100000:0.0:1789048534.748181:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097650304 00000100:00100000:0.0:1789048534.748262:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 299 00000100:00100000:0.0:1789048534.748273:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+11:8730:x1875953097650304:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789048534.748482:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+11:8730:x1875953097650304:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 210us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048534.748490:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 299 00000100:00100000:2.0:1789048534.784446:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048534.784675:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097650432 00000100:00100000:3.0:1789048534.784689:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097650432 00000100:00100000:3.0:1789048534.784763:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 300 00000100:00100000:3.0:1789048534.784775:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+11:8730:x1875953097650432:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789048534.785258:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+11:8730:x1875953097650432:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 482us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048534.785268:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 300 00000100:00100000:1.0:1789048534.800618:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048534.800858:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097650560 00000100:00100000:2.0:1789048534.800872:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097650560 00000100:00100000:2.0:1789048534.800965:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 301 00000100:00100000:2.0:1789048534.800977:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+11:8730:x1875953097650560:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789048534.801211:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+11:8730:x1875953097650560:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 235us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048534.801220:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 301 00000100:00100000:2.0:1789048534.821149:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048534.821302:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097650688 00000100:00100000:3.0:1789048534.821315:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097650688 00000100:00100000:0.0:1789048534.821689:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 302 00000100:00100000:0.0:1789048534.821710:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+11:8726:x1875953097650688:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789048534.821738:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048534.821767:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef38c00/0x133f221c08775ee8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29645 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048534.821838:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef38c00/0x133f221c08775ee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29645 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048534.821853:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef38c00/0x133f221c08775ee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29645 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048534.821865:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38c00, rc 0) 00000100:00100000:0.0:1789048534.821964:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:8726:x1875953097650688:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 262us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048534.821973:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 302 00000100:00100000:1.0:1789048534.827185:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048534.827380:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097650816 00000100:00100000:0.0:1789048534.827393:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097650816 00000100:00100000:0.0:1789048534.827470:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 303 00000100:00100000:0.0:1789048534.827483:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:8726:x1875953097650816:12345-192.168.202.16@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789048534.827690:0:6492:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789048534.827726:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789048534.827731:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789048534.827741:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789048534.827744:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789048534.827748:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789048534.835071:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:8726:x1875953097650816:12345-192.168.202.16@tcp:256:mount.lustre.0 Request processed in 7571us (7885us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048534.835092:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 303 00000100:00100000:2.0:1789048534.840158:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048534.840282:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097650944 00000100:00100000:0.0:1789048534.840297:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097650944 00000100:00100000:0.0:1789048534.840449:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 304 00000100:00100000:0.0:1789048534.840463:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:8726:x1875953097650944:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789048534.840486:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048534.840521:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef38e00/0x133f221c08775eef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b2964c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048534.840562:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef38e00/0x133f221c08775eef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2964c expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048534.840576:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef38e00/0x133f221c08775eef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2964c expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048534.840586:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38e00, rc 0) 00000100:00100000:0.0:1789048534.840653:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:8726:x1875953097650944:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 193us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048534.840661:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 304 00000100:00100000:1.0:1789048534.845152:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048534.845284:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097651072 00000100:00100000:0.0:1789048534.845299:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097651072 00000100:00100000:0.0:1789048534.845404:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 305 00000100:00100000:0.0:1789048534.845418:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:8726:x1875953097651072:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789048534.845764:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:8726:x1875953097651072:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 347us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048534.845774:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 305 00000100:00100000:1.0:1789048534.851492:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048534.853196:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097651200 00000100:00100000:0.0:1789048534.853218:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097651200 00000100:00100000:0.0:1789048534.853763:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 306 00000100:00100000:0.0:1789048534.853778:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:8726:x1875953097651200:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789048534.858811:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:8726:x1875953097651200:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 5009us (7306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048534.858832:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 306 00000100:00100000:3.0:1789048534.866065:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048534.867198:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097651328 00000100:00100000:2.0:1789048534.867218:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097651328 00000100:00100000:2.0:1789048534.867300:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 307 00000100:00100000:2.0:1789048534.867313:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:8736:x1875953097651328:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789048534.867987:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:8736:x1875953097651328:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 664us (1926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048534.868003:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 307 00000100:00100000:1.0:1789048534.875292:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048534.875466:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097651456 00000100:00100000:0.0:1789048534.875479:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097651456 00000100:00100000:0.0:1789048534.875598:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 308 00000100:00100000:0.0:1789048534.875610:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:8736:x1875953097651456:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789048534.875855:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:8736:x1875953097651456:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 246us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048534.875864:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 308 00000100:00100000:1.0:1789048534.889616:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048534.889664:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048534.889696:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048534.889729:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048534.889769:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097652224 00000100:00100000:1.0:1789048534.889782:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097652224 00000100:00100000:1.0:1789048534.890246:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097652352 00000100:00100000:1.0:1789048534.890252:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097652352 00000100:00100000:1.0:1789048534.890270:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097651584 00000100:00100000:1.0:1789048534.890272:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097651584 00000100:00100000:1.0:1789048534.890282:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097651840 00000100:00100000:1.0:1789048534.890284:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097651840 00000100:00100000:1.0:1789048534.890299:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 143 00000100:00100000:1.0:1789048534.890311:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097652224:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048534.891028:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097652224:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 715us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048534.891049:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 143 00000100:00100000:3.0:1789048534.891377:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 144 00000100:00100000:3.0:1789048534.891394:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097652352:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048534.891446:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097652352:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 61us (1782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048534.891486:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 144 00000100:00100000:3.0:1789048534.891503:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:3.0:1789048534.891509:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2390:x1875953097651584:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789048534.891548:0:6498:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 433baedb-13e1-412e-b0c8-ceb1dbfcf502@192.168.202.16@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:3.0:1789048534.891594:0:6498:0:(genops.c:1384:class_connect()) connect: client 433baedb-13e1-412e-b0c8-ceb1dbfcf502, cookie 0x133f221c08775ef6 00000004:00100000:3.0:1789048534.891629:0:6498:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789048534.891795:0:6498:0:(import.c:65:import_set_state_nolock()) ffff959c3fb25800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789048534.891831:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+6:2390:x1875953097651584:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 320us (2134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048534.892364:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:0.0:1789048534.892372:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1875953097651840:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789048534.892398:0:6497:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 433baedb-13e1-412e-b0c8-ceb1dbfcf502@192.168.202.16@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:0.0:1789048534.892434:0:6497:0:(genops.c:1384:class_connect()) connect: client 433baedb-13e1-412e-b0c8-ceb1dbfcf502, cookie 0x133f221c08775efd 00000004:00100000:0.0:1789048534.892464:0:6497:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789048534.897594:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00080000:1.0:1789048534.901935:0:6497:0:(import.c:65:import_set_state_nolock()) ffff959c3fb94800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789048534.902103:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+6:2390:x1875953097651840:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 9724us (12367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048534.902115:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:1.0:1789048534.919139:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048534.919193:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048534.919251:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048534.919318:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097651712 00000100:00100000:3.0:1789048534.919382:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097651712 00000100:00100000:3.0:1789048534.919467:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097652096 00000100:00100000:3.0:1789048534.919471:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097652096 00000100:00100000:3.0:1789048534.919483:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097651968 00000100:00100000:3.0:1789048534.919485:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097651968 00000100:00100000:3.0:1789048534.919517:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:3.0:1789048534.919528:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+7:0:x1875953097651712:12345-192.168.202.16@tcp:41:mount.lustre.0 00000100:00100000:0.0:1789048534.919539:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:0.0:1789048534.919562:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+7:8726:x1875953097652096:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789048534.919590:0:8649:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000004:00000024:0.0:1789048534.919610:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789048534.919703:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+7:0:x1875953097651712:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 177us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048534.919712:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+7:8726:x1875953097652096:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 157us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048534.919713:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:0.0:1789048534.919730:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:3.0:1789048534.919744:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:3.0:1789048534.919752:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+6:0:x1875953097651968:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789048534.919770:0:8649:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00080000:1.0:1789048534.920160:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789048534.920167:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048534.920260:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+6:0:x1875953097651968:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 508us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048534.920268:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:2.0:1789048534.924722:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048534.929928:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097652480 00000100:00100000:0.0:1789048534.929945:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097652480 00000100:00100000:0.0:1789048534.930029:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:0.0:1789048534.930040:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+6:8726:x1875953097652480:12345-192.168.202.16@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789048534.930145:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+6:8726:x1875953097652480:12345-192.168.202.16@tcp:40:mount.lustre.0 Request processed in 106us (5434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048534.930152:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:1.0:1789048534.934061:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048534.936482:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048534.937506:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048534.937915:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097652864 00000100:00100000:1.0:1789048534.937925:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097652864 00000100:00100000:1.0:1789048534.937998:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:1.0:1789048534.938008:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+6:8726:x1875953097652864:12345-192.168.202.16@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789048534.938097:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+6:8726:x1875953097652864:12345-192.168.202.16@tcp:900:mount.lustre.0 Request processed in 90us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048534.938106:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:0.0:1789048534.939735:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097652608 00000100:00100000:0.0:1789048534.939748:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097652608 00000100:00100000:3.0:1789048534.942093:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097652736 00000100:00100000:3.0:1789048534.942108:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097652736 00000100:00100000:2.0:1789048534.942422:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:2.0:1789048534.942430:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2390:x1875953097652736:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789048534.942467:0:8413:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 433baedb-13e1-412e-b0c8-ceb1dbfcf502@192.168.202.16@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:2.0:1789048534.942498:0:8413:0:(genops.c:1384:class_connect()) connect: client 433baedb-13e1-412e-b0c8-ceb1dbfcf502, cookie 0x133f221c08775f04 00002000:00100000:2.0:1789048534.942512:0:8413:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 433baedb-13e1-412e-b0c8-ceb1dbfcf502/ffff959c3fb41000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789048534.942542:0:8413:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789048534.945320:0:8413:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789048534.945386:0:8413:0:(import.c:65:import_set_state_nolock()) ffff959c3fb44000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789048534.945460:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+6:2390:x1875953097652736:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 3027us (8988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048534.945470:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:2.0:1789048534.945562:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048534.946105:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097652992 00000100:00100000:0.0:1789048534.946115:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097652992 00000100:00100000:0.0:1789048534.946154:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:0.0:1789048534.946162:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+6:8726:x1875953097652992:12345-192.168.202.16@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789048534.946236:0:6500:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789048534.946278:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+6:8726:x1875953097652992:12345-192.168.202.16@tcp:33:mount.lustre.0 Request processed in 117us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048534.946284:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:1.0:1789048534.948485:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:1.0:1789048534.948496:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08204380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1875953097652608:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789048534.953154:0:8804:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 433baedb-13e1-412e-b0c8-ceb1dbfcf502@192.168.202.16@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:1.0:1789048534.953201:0:8804:0:(genops.c:1384:class_connect()) connect: client 433baedb-13e1-412e-b0c8-ceb1dbfcf502, cookie 0x133f221c08775f0b 00002000:00100000:1.0:1789048534.953216:0:8804:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 433baedb-13e1-412e-b0c8-ceb1dbfcf502/ffff959c3fb90800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789048534.953236:0:8804:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789048534.953318:0:8804:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789048534.953363:0:8804:0:(import.c:65:import_set_state_nolock()) ffff959c3fb91800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789048534.953437:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08204380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+6:2390:x1875953097652608:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 4940us (19384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048534.953447:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00010000:00010000:2.0:1789048535.006104:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048536.030798:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048536.541665:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111359360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048536.541735:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048536.541830:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111359360 00000100:00100000:2.0:1789048536.541838:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111359360 00000100:00100000:2.0:1789048536.541890:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789048536.541900:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111359360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789048536.541930:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789048536.541974:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111359360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048536.541986:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1789048536.542009:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789048536.542036:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b06971500 x1875953111359360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048536.542054:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111359360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048536.542526:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111359488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048536.542559:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048536.542647:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111359488 00000100:00100000:3.0:1789048536.542652:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111359488 00000100:00100000:3.0:1789048536.542686:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789048536.542694:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111359488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789048536.542707:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048536.542738:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111359488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048536.542808:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1789048536.542825:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789048536.542844:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0820f100 x1875953111359488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048536.542859:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111359488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048536.552894:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08204e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111359616:0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.552965:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048536.553068:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111360128:0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.553124:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048536.553147:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111360640:0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.553169:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048536.553196:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789048536.553203:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08205c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111359744:0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.553238:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048536.553255:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111360256:0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.553272:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048536.553289:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111360768:0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.553308:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048536.553369:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08205880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111359872:0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.553391:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048536.553408:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111360384:0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.553426:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048536.553443:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111360896:0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.553461:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048536.553474:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789048536.553480:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111360000:0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.553498:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048536.553508:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111360512:0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.553524:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048536.553556:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111360128 00000100:00100000:1.0:1789048536.553564:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111360128 00000100:00100000:1.0:1789048536.553606:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111359872 00000100:00100000:1.0:1789048536.553609:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111359872 00000100:00100000:1.0:1789048536.553632:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789048536.553640:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111360128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.553705:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111360128:12345-0@lo:400:kworker.0 Request processed in 65us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048536.553712:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789048536.553728:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789048536.553735:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111359872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.553764:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111359872:12345-0@lo:400:kworker.0 Request processed in 30us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048536.553783:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789048536.553801:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111360640 00000100:00100000:1.0:1789048536.553804:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111360640 00000100:00100000:1.0:1789048536.553846:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111360512 00000100:00100000:1.0:1789048536.553849:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111360512 00000100:00100000:1.0:1789048536.553869:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789048536.553875:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111360640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.553905:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111360640:12345-0@lo:400:kworker.0 Request processed in 30us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048536.553911:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789048536.553921:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789048536.553927:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111360512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.553950:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111360512:12345-0@lo:400:kworker.0 Request processed in 24us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048536.553955:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789048536.553970:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111359744 00000100:00100000:1.0:1789048536.553973:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111359744 00000100:00100000:1.0:1789048536.553988:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111360256 00000100:00100000:1.0:1789048536.553995:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111360256 00000100:00100000:1.0:1789048536.554009:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111360768 00000100:00100000:1.0:1789048536.554011:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111360768 00000100:00100000:1.0:1789048536.554023:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111360384 00000100:00100000:1.0:1789048536.554025:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111360384 00000100:00100000:1.0:1789048536.554035:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111360896 00000100:00100000:1.0:1789048536.554037:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111360896 00000100:00100000:1.0:1789048536.554046:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111360000 00000100:00100000:1.0:1789048536.554048:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111360000 00000100:00100000:1.0:1789048536.554058:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789048536.554062:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111359744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.554089:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111359744:12345-0@lo:400:kworker.0 Request processed in 27us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048536.554095:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789048536.554105:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789048536.554111:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111360256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.554135:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111360256:12345-0@lo:400:kworker.0 Request processed in 24us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048536.554140:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789048536.554150:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789048536.554155:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111360768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.554179:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111360768:12345-0@lo:400:kworker.0 Request processed in 25us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048536.554184:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789048536.554192:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789048536.554197:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111360384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.554217:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111360384:12345-0@lo:400:kworker.0 Request processed in 20us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048536.554231:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789048536.554241:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789048536.554246:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111360896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.554269:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111360896:12345-0@lo:400:kworker.0 Request processed in 23us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048536.554275:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789048536.554284:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789048536.554289:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111360000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.554309:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111360000:12345-0@lo:400:kworker.0 Request processed in 21us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048536.554314:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789048536.554389:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08205c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111359744:0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.554400:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111360256:0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.554408:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111360768:0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.554416:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111360128:0@lo:400:kworker.0 00010000:00080000:1.0:1789048536.554428:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c2b611f80 x1875953111360640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048536.554439:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111360640:0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.554473:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111360000:0@lo:400:kworker.0 00010000:00080000:1.0:1789048536.554482:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c2b613800 x1875953111360512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048536.554490:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111360512:0@lo:400:kworker.0 00000100:00100000:1.0:1789048536.554507:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08205880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111359872:0@lo:400:kworker.0 00010000:00080000:1.0:1789048536.554516:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c2b612300 x1875953111360384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048536.554524:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111360384:0@lo:400:kworker.0 00010000:00080000:1.0:1789048536.554532:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c03e54000 x1875953111360896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048536.554540:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111360896:0@lo:400:kworker.0 00000100:00080000:1.0:1789048536.554562:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789048536.554565:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789048536.554568:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048536.555390:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111359616 00000100:00100000:2.0:1789048536.555400:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111359616 00000100:00100000:2.0:1789048536.555444:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789048536.555453:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111359616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048536.555512:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111359616:12345-0@lo:400:kworker.0 Request processed in 61us (2547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048536.555518:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789048536.555642:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08204e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111359616:0@lo:400:kworker.0 00010000:00010000:3.0:1789048537.053510:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048537.055980:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111361024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048537.056071:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048537.056236:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111361024 00000100:00100000:2.0:1789048537.056243:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111361024 00000100:00100000:2.0:1789048537.056294:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789048537.056303:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111361024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789048537.056363:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789048537.068470:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111361024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 12157us (12387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048537.068484:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789048537.070012:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111361024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048537.569836:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111361152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789048537.569903:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048537.570952:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111361152 00000100:00100000:0.0:1789048537.570960:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111361152 00000100:00100000:0.0:1789048537.571008:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789048537.571017:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111361152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789048537.571056:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048537.571123:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111361152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048537.571130:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1789048537.571176:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08091880 x1875953111361152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048537.571192:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111361152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048537.579985:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111361280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789048537.580053:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048537.582426:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111361280 00000100:00100000:3.0:1789048537.582441:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111361280 00000100:00100000:3.0:1789048537.582503:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789048537.582513:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111361280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789048537.582538:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048537.582618:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111361280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (2565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048537.582643:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1789048537.582689:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b06971500 x1875953111361280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048537.582708:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111361280:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789048538.082492:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048538.596370:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789048538.596397:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111361408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789048538.596481:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048538.596535:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111361408 00000100:00100000:0.0:1789048538.596543:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111361408 00000100:00100000:0.0:1789048538.596599:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789048538.596610:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111361408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789048538.596646:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789048538.596704:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111361408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048538.596712:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789048538.596798:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111361408:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789048539.101925:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048540.126372:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789048540.132320:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 433baedb-13e1-412e-b0c8-ceb1dbfcf502 00000001:00100000:1.0:1789048540.132505:0:9492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 433baedb-13e1-412e-b0c8-ceb1dbfcf502 00000001:00100000:0.0:1789048540.132894:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 433baedb-13e1-412e-b0c8-ceb1dbfcf502 00000100:00100000:0.0:1789048540.233588:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048540.233640:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048540.233673:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048540.233707:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048540.233766:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048540.233803:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048540.233829:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048540.233855:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097653248 00000100:00100000:0.0:1789048540.233865:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097653248 00000100:00100000:0.0:1789048540.233918:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097653376 00000100:00100000:0.0:1789048540.233921:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097653376 00000100:00100000:0.0:1789048540.233932:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097653632 00000100:00100000:0.0:1789048540.233946:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097653632 00000100:00100000:0.0:1789048540.233961:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097653504 00000100:00100000:0.0:1789048540.233963:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097653504 00000100:00100000:0.0:1789048540.233976:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 151 00000100:00100000:0.0:1789048540.233994:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097653248:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048540.234172:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097653120 00000100:00100000:2.0:1789048540.234177:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097653120 00000100:00100000:2.0:1789048540.234208:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 310 00000100:00100000:2.0:1789048540.234215:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2394:x1875953097653120:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048540.234294:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 152 00000100:00100000:3.0:1789048540.234306:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097653376:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048540.234392:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097653248:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 408us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048540.234400:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 151 00000100:00100000:0.0:1789048540.234418:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 153 00000100:00100000:0.0:1789048540.234424:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097653632:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048540.235373:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789048540.235386:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1789048540.235506:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 154 00000100:00100000:1.0:1789048540.235516:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097653504:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048540.247415:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2394:x1875953097653120:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 13187us (13761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048540.247432:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 310 00000100:00100000:2.0:1789048540.247520:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097653888 00000100:00100000:2.0:1789048540.247531:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097653888 00000100:00100000:2.0:1789048540.247583:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097653760 00000100:00100000:2.0:1789048540.247586:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097653760 00000100:00100000:2.0:1789048540.248274:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:2.0:1789048540.248288:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097653888:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048540.248378:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097653888:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 95us (14612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048540.248385:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:2.0:1789048540.248399:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:2.0:1789048540.248406:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+6:2393:x1875953097653760:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048540.248431:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+6:2393:x1875953097653760:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 25us (14601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048540.248437:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00080000:2.0:1789048540.248476:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789048540.248494:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789048540.248497:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789048540.248500:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048540.248718:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097653376:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 14413us (15042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048540.248727:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 152 00000100:00100000:0.0:1789048540.248962:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097653632:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 14535us (15253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048540.248972:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 153 00000100:00100000:1.0:1789048540.250357:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097653504:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 14818us (16527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048540.250385:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 154 00010000:00010000:2.0:1789048541.151275:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789048541.173210:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 433baedb-13e1-412e-b0c8-ceb1dbfcf502 00000001:02000400:3.0:1789048541.375695:0:12168:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1789048541.661998:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111361792:0@lo:400:kworker.0 00000100:00100000:0.0:1789048541.662056:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111361920:0@lo:400:kworker.0 00000100:00100000:3.0:1789048541.662077:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048541.662128:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111361664:0@lo:400:kworker.0 00000100:00100000:2.0:1789048541.662235:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111361536:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048541.663807:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048541.663895:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111362432:0@lo:400:kworker.0 00000100:00100000:0.0:1789048541.664316:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048541.664371:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111362944:0@lo:400:kworker.0 00000100:00100000:0.0:1789048541.664392:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048541.664454:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111361920 00000100:00100000:0.0:1789048541.664465:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111361920 00000100:00100000:0.0:1789048541.664522:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789048541.664531:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111361920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048541.664587:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111361920:12345-0@lo:400:kworker.0 Request processed in 57us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048541.664608:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789048541.664676:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111361920:0@lo:400:kworker.0 00000100:00100000:2.0:1789048541.665974:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048541.666023:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111362048:0@lo:400:kworker.0 00000100:00100000:2.0:1789048541.666054:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048541.666072:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111362560:0@lo:400:kworker.0 00000100:00100000:2.0:1789048541.666094:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048541.666116:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d310700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111363072:0@lo:400:kworker.0 00000100:00100000:2.0:1789048541.666135:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048541.666180:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111361792 00000100:00100000:2.0:1789048541.666188:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111361792 00000100:00100000:2.0:1789048541.666227:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111362432 00000100:00100000:2.0:1789048541.666230:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111362432 00000100:00100000:2.0:1789048541.666252:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111362944 00000100:00100000:2.0:1789048541.666256:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111362944 00000100:00100000:2.0:1789048541.666270:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111362048 00000100:00100000:2.0:1789048541.666272:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111362048 00000100:00100000:2.0:1789048541.666289:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789048541.666298:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111361792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048541.666367:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111361792:12345-0@lo:400:kworker.0 Request processed in 69us (4290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048541.666375:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789048541.666390:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789048541.666397:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111362432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048541.666432:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111362432:12345-0@lo:400:kworker.0 Request processed in 36us (2116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048541.666452:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789048541.666464:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789048541.666470:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111362944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048541.666500:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111362944:12345-0@lo:400:kworker.0 Request processed in 30us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048541.666505:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789048541.666514:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789048541.666521:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111362048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048541.666554:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111362048:12345-0@lo:400:kworker.0 Request processed in 33us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048541.666560:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789048541.666713:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111362560 00000100:00100000:2.0:1789048541.666725:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111362560 00000100:00100000:2.0:1789048541.666754:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111363072 00000100:00100000:2.0:1789048541.666758:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111363072 00000100:00100000:0.0:1789048541.666916:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111361536 00000100:00100000:0.0:1789048541.666921:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111361536 00000100:00100000:0.0:1789048541.666965:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789048541.666972:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2ef2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1875953111361536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789048541.667003:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048541.667046:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2ef2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1875953111361536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048541.667052:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1789048541.667394:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0747ca80 x1875953111362432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048541.667410:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111362432:0@lo:400:kworker.0 00010000:00080000:0.0:1789048541.667424:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3d311c00 x1875953111362944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048541.667432:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111362944:0@lo:400:kworker.0 00000100:00100000:2.0:1789048541.668060:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789048541.668077:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06972680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111362560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048541.668138:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06972680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111362560:12345-0@lo:400:kworker.0 Request processed in 68us (2043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048541.668145:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789048541.668163:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789048541.668172:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111363072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048541.668202:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111363072:12345-0@lo:400:kworker.0 Request processed in 33us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048541.668208:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1789048541.668254:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789048541.668260:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789048541.668263:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789048541.668292:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0820f100 x1875953111361536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048557 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048541.668311:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111361536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789048541.668326:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111362048:0@lo:400:kworker.0 00010000:00080000:2.0:1789048541.668357:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3d312300 x1875953111362560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048541.668365:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111362560:0@lo:400:kworker.0 00010000:00080000:2.0:1789048541.668375:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3d310700 x1875953111363072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048541.668381:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d310700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111363072:0@lo:400:kworker.0 00000100:00100000:3.0:1789048541.668525:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111361792:0@lo:400:kworker.0 00000100:00100000:3.0:1789048541.668537:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111362304:0@lo:400:kworker.0 00000100:00100000:3.0:1789048541.668573:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048541.668614:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d310e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875953111362816:0@lo:400:kworker.0 00000100:00100000:3.0:1789048541.668636:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048541.668663:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111363328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048541.668685:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048541.668710:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111363328 00000100:00100000:3.0:1789048541.668732:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111363328 00000100:00100000:3.0:1789048541.668928:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789048541.668937:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d312d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111363328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789048541.668951:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048541.668985:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d312d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111363328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048541.668991:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1789048541.669008:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789048541.669035:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b06970380 x1875953111363328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048557 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048541.669048:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111363328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789048541.669157:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111362304 00000100:00100000:0.0:1789048541.669162:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111362304 00000100:00100000:0.0:1789048541.669209:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111362816 00000100:00100000:0.0:1789048541.669213:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111362816 00000100:00100000:0.0:1789048541.669233:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789048541.669240:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111362304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048541.669278:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111362304:12345-0@lo:400:kworker.0 Request processed in 39us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048541.669296:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789048541.669311:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789048541.669317:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875953111362816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048541.669374:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875953111362816:12345-0@lo:400:kworker.0 Request processed in 57us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048541.669380:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:3.0:1789048541.669800:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048541.669834:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111362304:0@lo:400:kworker.0 00000100:00100000:3.0:1789048541.669845:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d310e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875953111362816:0@lo:400:kworker.0 00000100:00100000:1.0:1789048541.670042:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048541.670092:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111362176:0@lo:400:kworker.0 00000100:00100000:1.0:1789048541.670126:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048541.670153:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111362688:0@lo:400:kworker.0 00000100:00100000:1.0:1789048541.670176:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048541.670206:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111363200:0@lo:400:kworker.0 00000100:00100000:1.0:1789048541.670228:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048541.670263:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111362688 00000100:00100000:1.0:1789048541.670269:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111362688 00000100:00100000:1.0:1789048541.670310:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111363200 00000100:00100000:1.0:1789048541.670314:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111363200 00000100:00100000:1.0:1789048541.670351:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789048541.670359:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111362688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048541.670399:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111362688:12345-0@lo:400:kworker.0 Request processed in 42us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048541.670406:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789048541.670422:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789048541.670428:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111363200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048541.670455:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111363200:12345-0@lo:400:kworker.0 Request processed in 26us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048541.670461:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1789048541.670474:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789048541.670498:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3d313800 x1875953111362688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048541.670521:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111362688:0@lo:400:kworker.0 00010000:00080000:1.0:1789048541.670533:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3d310380 x1875953111363200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048541.670541:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111363200:0@lo:400:kworker.0 00000100:00100000:2.0:1789048541.670623:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111362176 00000100:00100000:2.0:1789048541.670628:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111362176 00000100:00100000:2.0:1789048541.670667:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789048541.670675:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111362176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048541.670727:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111362176:12345-0@lo:400:kworker.0 Request processed in 44us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048541.670734:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789048541.670939:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111362176:0@lo:400:kworker.0 00000100:00100000:3.0:1789048541.671005:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111361664 00000100:00100000:3.0:1789048541.671010:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111361664 00000100:00100000:3.0:1789048541.671048:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1789048541.671057:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111361664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048541.671105:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111361664:12345-0@lo:400:kworker.0 Request processed in 50us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048541.671111:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1789048541.671183:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111361664:0@lo:400:kworker.0 00000100:00100000:2.0:1789048542.173852:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111363456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048542.173928:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789048542.174525:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048542.174874:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111363456 00000100:00100000:0.0:1789048542.174884:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111363456 00000100:00100000:0.0:1789048542.174943:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789048542.174953:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111363456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789048542.174989:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789048542.175147:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111363456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 195us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048542.175154:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789048542.175235:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111363456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789048542.685817:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d310e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111363584:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048542.685881:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048542.685959:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111363584 00000100:00100000:3.0:1789048542.685966:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111363584 00000100:00100000:3.0:1789048542.686009:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789048542.686018:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d310380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111363584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789048542.686044:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048542.686087:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d310380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111363584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048542.686093:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1789048542.686132:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3d310e00 x1875953111363584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048542.686151:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d310e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111363584:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048542.686371:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111363712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048542.686398:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048542.686669:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111363712 00000100:00100000:0.0:1789048542.686675:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111363712 00000100:00100000:0.0:1789048542.686716:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789048542.686723:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d310e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111363712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789048542.686735:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048542.686781:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d310e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111363712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048542.686788:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1789048542.686814:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08091180 x1875953111363712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048542.686827:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111363712:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789048543.198455:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048543.709950:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111363840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048543.710025:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048543.710113:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111363840 00000100:00100000:1.0:1789048543.710121:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111363840 00000100:00100000:1.0:1789048543.710173:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789048543.710183:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111363840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789048543.710215:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789048543.719889:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111363840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9696us (9853us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048543.719962:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789048543.720950:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111363840:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789048544.225967:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048545.247302:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048545.344622:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048545.344679:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048545.344725:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048545.344779:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048545.344786:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097654656 00000100:00100000:2.0:1789048545.344803:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097654656 00000100:00100000:3.0:1789048545.344813:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048545.344846:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048545.344888:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048545.344925:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097654144 00000100:00100000:1.0:1789048545.344933:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097654144 00000100:00100000:0.0:1789048545.344960:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097654400 00000100:00100000:0.0:1789048545.344971:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097654400 00000100:00100000:1.0:1789048545.344981:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097654272 00000100:00100000:1.0:1789048545.344988:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097654272 00000100:00100000:1.0:1789048545.345016:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097654528 00000100:00100000:1.0:1789048545.345020:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097654528 00000100:00100000:0.0:1789048545.345056:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 161 00000100:00100000:0.0:1789048545.345075:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097654144:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048545.345196:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097654144:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 123us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048545.348552:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097654016 00000100:00100000:3.0:1789048545.348575:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097654016 00000100:00100000:3.0:1789048545.348650:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 312 00000100:00100000:3.0:1789048545.348664:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2394:x1875953097654016:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048545.348780:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2394:x1875953097654016:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 119us (4003us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048545.348809:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 312 00000100:00100000:2.0:1789048545.349132:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097654784 00000100:00100000:2.0:1789048545.349149:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097654784 00000100:00100000:2.0:1789048545.349241:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:2.0:1789048545.349253:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d311c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097654656:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048545.349329:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d311c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097654656:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 78us (4603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048545.349352:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:2.0:1789048545.349372:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:2.0:1789048545.349380:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097654784:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048545.349409:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097654784:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 30us (4523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048545.349415:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:1.0:1789048545.350512:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 162 00000100:00100000:1.0:1789048545.350530:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097654272:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048545.350577:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097654272:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 56us (5766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048545.350601:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 162 00000100:00100000:1.0:1789048545.350624:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 163 00000100:00100000:1.0:1789048545.350632:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097654400:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048545.350661:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097654400:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 30us (5983us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048545.350668:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 163 00000100:00100000:1.0:1789048545.350695:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 164 00000100:00100000:1.0:1789048545.350703:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097654528:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048545.350730:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097654528:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (5887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048545.350736:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 164 00000100:00080000:1.0:1789048545.350756:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789048545.350761:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789048545.350763:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789048545.350766:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789048545.367324:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 161 00010000:00010000:3.0:1789048546.270454:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048546.781903:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111363968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048546.781980:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048546.782030:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111364480:0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.782088:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048546.782109:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111364992:0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.782131:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048546.782144:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111365504:0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.782160:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048546.782187:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789048546.782192:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111364096:0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.782215:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048546.782236:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111364608:0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.782270:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048546.782284:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111365120:0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.782302:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048546.782315:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111365632:0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.782350:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048546.782377:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111364224:0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.782399:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048546.782415:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111364736:0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.782431:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048546.782453:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111365248:0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.782472:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048546.782487:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789048546.782492:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111364352:0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.782511:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048546.782524:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111364864:0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.782538:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048546.782551:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111365376:0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.782569:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048546.782590:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111363968 00000100:00100000:3.0:1789048546.782596:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111363968 00000100:00100000:3.0:1789048546.782639:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789048546.782646:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111363968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789048546.782687:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048546.782723:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111363968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048546.782730:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789048546.782750:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111364480 00000100:00100000:3.0:1789048546.782753:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111364480 00000100:00100000:3.0:1789048546.782768:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111364224 00000100:00100000:3.0:1789048546.782770:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111364224 00000100:00100000:3.0:1789048546.782778:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111364736 00000100:00100000:3.0:1789048546.782780:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111364736 00000100:00100000:3.0:1789048546.782790:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111365248 00000100:00100000:3.0:1789048546.782791:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111365248 00000100:00100000:3.0:1789048546.782800:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111364864 00000100:00100000:3.0:1789048546.782802:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111364864 00000100:00100000:3.0:1789048546.782811:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111365376 00000100:00100000:3.0:1789048546.782812:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111365376 00000100:00100000:3.0:1789048546.782830:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789048546.782836:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111364480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.782866:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111364480:12345-0@lo:400:kworker.0 Request processed in 31us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048546.782872:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789048546.782882:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789048546.782887:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111364224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.782912:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111364224:12345-0@lo:400:kworker.0 Request processed in 25us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048546.782917:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789048546.782927:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789048546.782932:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111364736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.782950:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111364736:12345-0@lo:400:kworker.0 Request processed in 19us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048546.782956:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789048546.782963:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789048546.782968:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111365248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.782985:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111365248:12345-0@lo:400:kworker.0 Request processed in 17us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048546.782990:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789048546.782997:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789048546.783001:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111364864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.783018:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111364864:12345-0@lo:400:kworker.0 Request processed in 17us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048546.783023:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789048546.783039:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789048546.783045:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111365376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.783067:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111365376:12345-0@lo:400:kworker.0 Request processed in 23us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048546.783072:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789048546.783085:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111364992 00000100:00100000:3.0:1789048546.783088:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111364992 00000100:00100000:3.0:1789048546.783102:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111365504 00000100:00100000:3.0:1789048546.783104:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111365504 00000100:00100000:3.0:1789048546.783112:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111365120 00000100:00100000:3.0:1789048546.783114:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111365120 00000100:00100000:3.0:1789048546.783122:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111365632 00000100:00100000:3.0:1789048546.783124:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111365632 00000100:00100000:3.0:1789048546.783132:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789048546.783137:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111364992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.783159:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111364992:12345-0@lo:400:kworker.0 Request processed in 22us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048546.783164:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789048546.783172:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789048546.783176:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111365504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.783193:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111365504:12345-0@lo:400:kworker.0 Request processed in 17us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048546.783198:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789048546.783205:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789048546.783209:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111365120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.783226:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111365120:12345-0@lo:400:kworker.0 Request processed in 16us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048546.783238:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789048546.783247:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789048546.783251:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111365632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.783271:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111365632:12345-0@lo:400:kworker.0 Request processed in 19us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048546.783276:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789048546.783291:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111364096 00000100:00100000:3.0:1789048546.783294:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111364096 00000100:00100000:3.0:1789048546.783312:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789048546.783317:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111364096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.783358:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111364096:12345-0@lo:400:kworker.0 Request processed in 41us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048546.783364:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789048546.783385:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111364608 00000100:00100000:3.0:1789048546.783388:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111364608 00000100:00100000:3.0:1789048546.783409:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111364352 00000100:00100000:3.0:1789048546.783411:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111364352 00000100:00100000:3.0:1789048546.783421:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789048546.783426:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111364608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.783452:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111364608:12345-0@lo:400:kworker.0 Request processed in 26us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048546.783458:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789048546.783468:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789048546.783473:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111364352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.783496:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111364352:12345-0@lo:400:kworker.0 Request processed in 23us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048546.783510:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1789048546.783543:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789048546.783548:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789048546.783550:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048546.783552:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789048546.783595:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111364352:0@lo:400:kworker.0 00010000:00080000:3.0:1789048546.783607:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb57b80 x1875953111364864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048546.783616:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111364864:0@lo:400:kworker.0 00010000:00080000:3.0:1789048546.783624:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb57800 x1875953111365376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048546.783633:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111365376:0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.783641:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111364224:0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.783648:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111364736:0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.783655:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111365248:0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.783702:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111364096:0@lo:400:kworker.0 00000100:00100000:3.0:1789048546.783710:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111364608:0@lo:400:kworker.0 00010000:00080000:3.0:1789048546.783719:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb54e00 x1875953111365120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048546.783727:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111365120:0@lo:400:kworker.0 00010000:00080000:3.0:1789048546.783734:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb54000 x1875953111365632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048546.783747:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111365632:0@lo:400:kworker.0 00010000:00080000:3.0:1789048546.783755:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb54700 x1875953111363968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048562 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048546.783766:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111363968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048546.783775:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111364480:0@lo:400:kworker.0 00010000:00080000:3.0:1789048546.783783:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb56300 x1875953111364992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048546.783790:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111364992:0@lo:400:kworker.0 00010000:00080000:3.0:1789048546.783798:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb56a00 x1875953111365504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048546.783806:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111365504:0@lo:400:kworker.0 00000100:00100000:0.0:1789048546.790459:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789048546.790486:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111365760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048546.791142:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048546.791384:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111365760 00000100:00100000:3.0:1789048546.791393:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111365760 00000100:00100000:3.0:1789048546.791449:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789048546.791460:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111365760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789048546.791485:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048546.791541:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111365760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048546.791548:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1789048546.791642:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08091f80 x1875953111365760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048562 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048546.791661:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111365760:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789048547.297122:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048547.298084:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111365888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048547.298151:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048547.298264:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111365888 00000100:00100000:3.0:1789048547.298272:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111365888 00000100:00100000:3.0:1789048547.298321:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789048547.298330:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111365888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789048547.298387:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789048547.298433:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111365888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048547.298440:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789048547.298558:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111365888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789048547.806467:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111366016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789048547.806535:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048547.806631:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111366016 00000100:00100000:0.0:1789048547.806638:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111366016 00000100:00100000:2.0:1789048547.806750:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111366144:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048547.806777:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048547.806806:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111366144 00000100:00100000:2.0:1789048547.806810:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111366144 00000100:00100000:0.0:1789048547.808574:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789048547.808590:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111366016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789048547.808624:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048547.808700:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111366016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048547.808707:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789048547.811584:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789048547.811601:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06970700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111366144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789048547.811629:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789048547.811719:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06970700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111366144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (4940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048547.811726:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1789048547.811778:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b06970380 x1875953111366144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048547.811798:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111366144:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1789048547.811849:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08091f80 x1875953111366016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048547.811862:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111366016:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789048548.319991:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048548.829585:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111366272:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048548.829667:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048548.829880:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111366272 00000100:00100000:3.0:1789048548.829888:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111366272 00000100:00100000:3.0:1789048548.829939:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789048548.829949:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111366272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789048548.829991:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789048548.830047:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111366272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048548.830055:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789048548.830136:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111366272:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789048549.341824:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789048549.565090:0:12483:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789048549.565384:0:12483:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789048550.366369:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048550.463613:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048550.463695:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048550.463728:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048550.463760:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048550.463795:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048550.463818:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048550.463842:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048550.463996:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097655040 00000100:00100000:1.0:1789048550.464019:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097655040 00000100:00100000:1.0:1789048550.464077:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097655296 00000100:00100000:1.0:1789048550.464081:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097655296 00000100:00100000:1.0:1789048550.464095:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097655168 00000100:00100000:1.0:1789048550.464097:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097655168 00000100:00100000:1.0:1789048550.464109:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097655424 00000100:00100000:1.0:1789048550.464111:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097655424 00000100:00100000:1.0:1789048550.464126:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 171 00000100:00100000:1.0:1789048550.464135:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097655040:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048550.464214:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097655040:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 79us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048550.464223:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 171 00000100:00100000:1.0:1789048550.464243:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 172 00000100:00100000:1.0:1789048550.464250:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097655296:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048550.464277:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097655296:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 28us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048550.464283:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 172 00000100:00100000:1.0:1789048550.464294:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 173 00000100:00100000:1.0:1789048550.464301:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097655168:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048550.464324:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097655168:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 24us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048550.464356:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 173 00000100:00100000:1.0:1789048550.464369:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 174 00000100:00100000:1.0:1789048550.464376:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097655424:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048550.464400:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097655424:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 24us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048550.464414:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 174 00000100:00100000:1.0:1789048550.464435:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097654912 00000100:00100000:1.0:1789048550.464439:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097654912 00000100:00100000:1.0:1789048550.464465:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 314 00000100:00100000:1.0:1789048550.464471:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2393:x1875953097654912:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048550.464499:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2393:x1875953097654912:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 28us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048550.464506:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 314 00000100:00100000:3.0:1789048550.466174:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097655552 00000100:00100000:3.0:1789048550.466191:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097655552 00000100:00100000:3.0:1789048550.466255:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097655680 00000100:00100000:3.0:1789048550.466259:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097655680 00000100:00100000:3.0:1789048550.466294:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:3.0:1789048550.466304:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097655552:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048550.466419:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097655552:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 117us (2690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048550.466438:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:3.0:1789048550.466456:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:3.0:1789048550.466462:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097655680:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048550.466489:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097655680:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (2646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048550.466495:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00080000:3.0:1789048550.466525:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789048550.466529:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789048550.466532:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789048550.466535:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789048551.391126:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789048551.699063:0:12580:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789048551.699302:0:12580:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789048551.902152:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111366400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048551.902576:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111366528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048551.902633:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048551.903508:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048551.903549:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789048551.903557:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111366784:0@lo:400:kworker.0 00000100:00100000:2.0:1789048551.903591:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048551.903637:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111366656:0@lo:400:kworker.0 00000100:00100000:2.0:1789048551.903687:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048551.903754:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111366528 00000100:00100000:2.0:1789048551.903764:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111366528 00000100:00100000:2.0:1789048551.903821:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111366400 00000100:00100000:2.0:1789048551.903825:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111366400 00000100:00100000:2.0:1789048551.903845:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789048551.903853:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111366528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789048551.903885:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789048551.903929:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111366528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048551.903937:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789048551.904312:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111367040:0@lo:400:kworker.0 00000100:00100000:3.0:1789048551.904367:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048551.904389:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111367552:0@lo:400:kworker.0 00000100:00100000:3.0:1789048551.904412:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789048551.904452:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b06970380 x1875953111366528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048567 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048551.904470:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111366528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048551.904488:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789048551.904493:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111367168:0@lo:400:kworker.0 00000100:00100000:3.0:1789048551.904515:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048551.904532:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111367680:0@lo:400:kworker.0 00000100:00100000:3.0:1789048551.904548:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048551.904588:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111367552 00000100:00100000:3.0:1789048551.904592:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111367552 00000100:00100000:3.0:1789048551.904634:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111367680 00000100:00100000:3.0:1789048551.904637:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111367680 00000100:00100000:3.0:1789048551.904656:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789048551.904663:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111367552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048551.904699:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111367552:12345-0@lo:400:kworker.0 Request processed in 36us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048551.904704:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789048551.904720:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789048551.904726:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111367680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048551.904751:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111367680:12345-0@lo:400:kworker.0 Request processed in 25us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048551.904755:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789048551.904771:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111367168 00000100:00100000:3.0:1789048551.904775:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111367168 00000100:00100000:3.0:1789048551.904798:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789048551.904804:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111367168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048551.904834:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111367168:12345-0@lo:400:kworker.0 Request processed in 31us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048551.904840:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789048551.904874:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111367168:0@lo:400:kworker.0 00010000:00080000:3.0:1789048551.904884:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c2b611500 x1875953111367680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048551.904891:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111367680:0@lo:400:kworker.0 00010000:00080000:3.0:1789048551.904899:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c2b612680 x1875953111367552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048551.904913:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111367552:0@lo:400:kworker.0 00000100:00100000:0.0:1789048551.905085:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789048551.905094:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111366400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789048551.905106:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048551.905139:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111366400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048551.905144:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789048551.905566:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111366784 00000100:00100000:1.0:1789048551.905572:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111366784 00000100:00100000:1.0:1789048551.905639:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111367040 00000100:00100000:1.0:1789048551.905642:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111367040 00000100:00100000:1.0:1789048551.905662:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789048551.905669:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111366784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048551.905707:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111366784:12345-0@lo:400:kworker.0 Request processed in 38us (2115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048551.905713:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789048551.905726:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789048551.905732:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111367040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048551.905761:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111367040:12345-0@lo:400:kworker.0 Request processed in 30us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048551.905766:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789048551.906373:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111366656 00000100:00100000:2.0:1789048551.906381:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111366656 00000100:00100000:2.0:1789048551.906434:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789048551.906441:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3623:x1875953111366656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048551.906481:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3623:x1875953111366656:12345-0@lo:400:kworker.0 Request processed in 42us (2794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048551.906488:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00080000:2.0:1789048551.906516:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789048551.906521:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789048551.906542:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111367296:0@lo:400:kworker.0 00000100:00100000:2.0:1789048551.906572:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048551.907731:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111367296 00000100:00100000:0.0:1789048551.907740:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111367296 00000100:00100000:0.0:1789048551.907786:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789048551.907795:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111367296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048551.907844:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111367296:12345-0@lo:400:kworker.0 Request processed in 51us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048551.907851:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:1.0:1789048551.907921:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048551.908531:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111367040:0@lo:400:kworker.0 00000100:00100000:2.0:1789048551.908646:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08206d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111367808:0@lo:400:kworker.0 00000100:00100000:2.0:1789048551.908688:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048551.908727:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111367296:0@lo:400:kworker.0 00000100:00100000:2.0:1789048551.908738:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789048551.908746:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111366912:0@lo:400:kworker.0 00000100:00100000:2.0:1789048551.908771:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048551.908791:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111367424:0@lo:400:kworker.0 00000100:00100000:2.0:1789048551.908810:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048551.908827:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08205180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111367936:0@lo:400:kworker.0 00000100:00100000:2.0:1789048551.908846:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048551.908875:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111366912 00000100:00100000:2.0:1789048551.908880:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111366912 00000100:00100000:2.0:1789048551.908913:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789048551.908920:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111366912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048551.909780:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111367808 00000100:00100000:3.0:1789048551.909787:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111367808 00000100:00100000:2.0:1789048551.909895:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111366912:12345-0@lo:400:kworker.0 Request processed in 974us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048551.909922:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789048551.909962:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111367424 00000100:00100000:2.0:1789048551.909966:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111367424 00000100:00100000:0.0:1789048551.910026:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111366912:0@lo:400:kworker.0 00000100:00100000:3.0:1789048551.910098:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111367936 00000100:00100000:3.0:1789048551.910102:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111367936 00000100:00100000:0.0:1789048551.910138:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789048551.910147:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111367808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048551.910200:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111367808:12345-0@lo:400:kworker.0 Request processed in 54us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048551.910205:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789048551.910234:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08206d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111367808:0@lo:400:kworker.0 00000100:00080000:1.0:1789048551.910581:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789048551.910585:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789048551.910662:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789048551.910670:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111367424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048551.910712:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111367424:12345-0@lo:400:kworker.0 Request processed in 43us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048551.910718:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789048551.910750:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111366656:0@lo:400:kworker.0 00000100:00100000:2.0:1789048551.910792:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111366784:0@lo:400:kworker.0 00000100:00100000:3.0:1789048551.910806:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00010000:00080000:2.0:1789048551.910808:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb56a00 x1875953111366400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048567 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048551.910813:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111367936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048551.910827:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111366400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048551.910846:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111367936:12345-0@lo:400:kworker.0 Request processed in 34us (1999us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048551.910851:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00010000:00080000:2.0:1789048551.910854:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c2b610e00 x1875953111367424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048551.910862:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111367424:0@lo:400:kworker.0 00010000:00080000:2.0:1789048551.910872:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08205180 x1875953111367936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048551.910880:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08205180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111367936:0@lo:400:kworker.0 00000100:00100000:0.0:1789048552.413555:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111368064:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789048552.413578:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048552.413654:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048552.413952:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111368064 00000100:00100000:3.0:1789048552.413962:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111368064 00000100:00100000:3.0:1789048552.414012:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789048552.414022:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111368064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789048552.414059:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789048552.414162:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111368064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048552.414169:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789048552.414388:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111368064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048552.926497:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789048552.926519:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111368192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789048552.926590:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048552.926699:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111368192 00000100:00100000:2.0:1789048552.926708:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111368192 00000100:00100000:2.0:1789048552.926757:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789048552.926766:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111368192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789048552.926799:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789048552.926843:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111368192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048552.926850:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:2.0:1789048552.926894:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d89180 x1875953111368192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048552.926914:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111368192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789048552.927177:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111368320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048552.927203:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048552.927283:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111368320 00000100:00100000:3.0:1789048552.927288:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111368320 00000100:00100000:3.0:1789048552.927322:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789048552.927329:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111368320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789048552.927371:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048552.927412:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111368320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048552.927418:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1789048552.927553:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb54a80 x1875953111368320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048552.927562:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111368320:0@lo:13:osp-pre-0-1.0 00000020:00000004:2.0:1789048553.431837:0:12679:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789048553.432213:0:12679:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789048553.440947:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048553.953762:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789048553.953785:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111368448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048553.953873:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048553.953999:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111368448 00000100:00100000:3.0:1789048553.954007:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111368448 00000100:00100000:3.0:1789048553.954060:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789048553.954070:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111368448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789048553.954109:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789048553.954164:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111368448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048553.954171:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789048553.954379:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111368448:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789048554.469821:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789048555.373234:0:12776:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789048555.373538:0:12776:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789048555.485734:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048555.584886:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048555.584950:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048555.584999:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048555.585024:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048555.585046:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048555.585070:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048555.585101:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048555.585136:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097656064 00000100:00100000:1.0:1789048555.585148:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097656064 00000100:00100000:1.0:1789048555.585215:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097656320 00000100:00100000:1.0:1789048555.585218:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097656320 00000100:00100000:1.0:1789048555.585235:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097655936 00000100:00100000:1.0:1789048555.585238:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097655936 00000100:00100000:1.0:1789048555.585251:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097656192 00000100:00100000:1.0:1789048555.585254:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097656192 00000100:00100000:1.0:1789048555.585270:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 181 00000100:00100000:1.0:1789048555.585282:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097656064:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048555.585394:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097656064:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 114us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048555.585402:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 181 00000100:00100000:1.0:1789048555.585420:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 182 00000100:00100000:1.0:1789048555.585426:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08206a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097656320:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048555.585453:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08206a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097656320:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048555.585458:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 182 00000100:00100000:1.0:1789048555.585469:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 183 00000100:00100000:1.0:1789048555.585475:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097655936:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048555.585513:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097655936:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 39us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048555.585527:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 183 00000100:00100000:1.0:1789048555.585540:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 184 00000100:00100000:1.0:1789048555.585547:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097656192:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048555.585573:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097656192:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048555.585578:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 184 00000100:00100000:3.0:1789048555.585634:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097655808 00000100:00100000:3.0:1789048555.585639:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097655808 00000100:00100000:1.0:1789048555.585755:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097656448 00000100:00100000:1.0:1789048555.585759:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097656448 00000100:00100000:1.0:1789048555.585829:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097656576 00000100:00100000:1.0:1789048555.585832:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097656576 00000100:00100000:0.0:1789048555.589740:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:0.0:1789048555.589777:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08207800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2390:x1875953097656448:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:0.0:1789048555.589827:0:8413:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775f0b 00000100:00080000:0.0:1789048555.589844:0:8413:0:(import.c:65:import_set_state_nolock()) ffff959c3fb91800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789048555.590037:0:8413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789048555.590265:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08207800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+2:2390:x1875953097656448:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 506us (5191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048555.590274:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:0.0:1789048555.590305:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:0.0:1789048555.590313:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08207480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2390:x1875953097656576:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:0.0:1789048555.590329:0:8413:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775f04 00000100:00080000:0.0:1789048555.590364:0:8413:0:(import.c:65:import_set_state_nolock()) ffff959c3fb44000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789048555.590397:0:8413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:1.0:1789048555.590654:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789048555.590660:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789048555.590664:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789048555.590668:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789048555.591399:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048555.591844:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08207480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+2:2390:x1875953097656576:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 1526us (6736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048555.591867:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00010000:00010000:0.0:1789048555.591897:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048555.594712:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 316 00000100:00100000:3.0:1789048555.594743:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2393:x1875953097655808:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048555.594865:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2393:x1875953097655808:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 137us (9992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048555.594877:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 316 00010000:00010000:3.0:1789048556.510451:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048557.022132:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111368704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048557.022258:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048557.022364:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111368704 00000100:00100000:0.0:1789048557.022364:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111368576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048557.022375:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111368704 00000100:00100000:0.0:1789048557.022391:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048557.022435:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111368576 00000100:00100000:2.0:1789048557.022439:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111368576 00000100:00100000:0.0:1789048557.022449:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789048557.022458:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789048557.022459:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111368704:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789048557.022477:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111368576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789048557.022499:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1789048557.022499:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048557.022626:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111368704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 167us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048557.022634:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1789048557.022718:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789048557.022797:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111368576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 331us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048557.022804:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789048557.028039:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111368832:0@lo:400:kworker.0 00000100:00100000:1.0:1789048557.028039:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111369088:0@lo:400:kworker.0 00000100:00100000:2.0:1789048557.028120:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111368960:0@lo:400:kworker.0 00010000:00080000:0.0:1789048557.037421:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb57480 x1875953111368704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048573 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048557.037462:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111368704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048557.039664:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048557.039746:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111369344:0@lo:400:kworker.0 00000100:00100000:3.0:1789048557.039804:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048557.039830:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111369856:0@lo:400:kworker.0 00000100:00100000:3.0:1789048557.039881:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048557.040324:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789048557.040360:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111369216:0@lo:400:kworker.0 00000100:00100000:3.0:1789048557.040396:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048557.040435:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111369728:0@lo:400:kworker.0 00000100:00100000:3.0:1789048557.040459:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048557.040514:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111368832 00000100:00100000:3.0:1789048557.040524:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111368832 00000100:00100000:3.0:1789048557.040593:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1789048557.040604:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3623:x1875953111368832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048557.040677:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3623:x1875953111368832:12345-0@lo:400:kworker.0 Request processed in 64us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048557.040686:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789048557.040687:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048557.040713:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111369600:0@lo:400:kworker.0 00000100:00100000:3.0:1789048557.040728:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111369344 00000100:00100000:3.0:1789048557.040732:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111369344 00000100:00100000:1.0:1789048557.040738:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048557.040758:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111370112:0@lo:400:kworker.0 00000100:00100000:3.0:1789048557.040768:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111369088 00000100:00100000:3.0:1789048557.040770:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111369088 00000100:00100000:1.0:1789048557.040779:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048557.040786:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789048557.040792:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111369344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048557.040812:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111369216 00000100:00100000:1.0:1789048557.040816:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111369216 00000100:00100000:3.0:1789048557.040828:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111369344:12345-0@lo:400:kworker.0 Request processed in 37us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048557.040834:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789048557.040846:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789048557.040852:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111369088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048557.040889:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111369088:12345-0@lo:400:kworker.0 Request processed in 37us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048557.041252:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111369600 00000100:00100000:1.0:1789048557.041258:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111369600 00000100:00100000:1.0:1789048557.041292:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111370112 00000100:00100000:1.0:1789048557.041314:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111370112 00000100:00100000:1.0:1789048557.041357:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789048557.041363:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111369216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048557.041402:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111369216:12345-0@lo:400:kworker.0 Request processed in 40us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048557.041409:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789048557.041683:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789048557.041694:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08205880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111369600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048557.041729:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08205880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111369600:12345-0@lo:400:kworker.0 Request processed in 39us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048557.041735:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789048557.041748:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789048557.041753:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111370112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048557.041779:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111370112:12345-0@lo:400:kworker.0 Request processed in 26us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048557.041785:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:1.0:1789048557.041814:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048557.042486:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789048557.042519:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111369856 00000100:00100000:3.0:1789048557.042526:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111369856 00000100:00100000:3.0:1789048557.042585:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111369728 00000100:00100000:3.0:1789048557.042589:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111369728 00000100:00100000:3.0:1789048557.042613:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789048557.042620:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111369856:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789048557.047161:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d89500 x1875953111368576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048573 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048557.047203:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111368576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048557.048314:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048557.049760:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111368960 00000100:00100000:0.0:1789048557.049773:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111368960 00000100:00100000:0.0:1789048557.049852:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789048557.049863:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111368960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048557.050011:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111369472:0@lo:400:kworker.0 00000100:00100000:1.0:1789048557.050057:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789048557.050072:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111369728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048557.050073:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048557.050123:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111369472 00000100:00100000:2.0:1789048557.050128:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111369472 00000100:00100000:2.0:1789048557.050161:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789048557.050170:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111369472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048557.050208:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111369472:12345-0@lo:400:kworker.0 Request processed in 40us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048557.050216:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789048557.050403:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111369728:12345-0@lo:400:kworker.0 Request processed in 336us (9943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048557.050411:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789048557.050454:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111369472:0@lo:400:kworker.0 00000100:00100000:2.0:1789048557.050463:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111369984:0@lo:400:kworker.0 00000100:00100000:2.0:1789048557.050488:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048557.050511:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111369984 00000100:00100000:2.0:1789048557.050515:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111369984 00000100:00100000:2.0:1789048557.050541:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789048557.050548:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111369984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048557.050595:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111369984:12345-0@lo:400:kworker.0 Request processed in 47us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048557.050601:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789048557.050649:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111369984:0@lo:400:kworker.0 00000100:00100000:1.0:1789048557.051374:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111369216:0@lo:400:kworker.0 00010000:00080000:1.0:1789048557.051393:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb56a00 x1875953111369728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048557.051736:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111369728:0@lo:400:kworker.0 00000100:00100000:1.0:1789048557.051754:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111368832:0@lo:400:kworker.0 00000100:00100000:1.0:1789048557.051766:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111369344:0@lo:400:kworker.0 00010000:00080000:1.0:1789048557.051961:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c2b610e00 x1875953111369856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048557.051972:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111369856:0@lo:400:kworker.0 00000100:00100000:3.0:1789048557.052248:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111369856:12345-0@lo:400:kworker.0 Request processed in 9624us (12362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048557.052260:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1789048557.052305:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048557.052313:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789048557.052361:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111369088:0@lo:400:kworker.0 00010000:00080000:3.0:1789048557.052376:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb54380 x1875953111369600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048557.052385:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111369600:0@lo:400:kworker.0 00010000:00080000:3.0:1789048557.052398:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c2b612300 x1875953111370112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048557.052405:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111370112:0@lo:400:kworker.0 00000100:00100000:0.0:1789048557.052682:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111368960:12345-0@lo:400:kworker.0 Request processed in 2818us (4370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048557.052691:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789048557.052787:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111368960:0@lo:400:kworker.0 00010000:00010000:2.0:1789048557.533767:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048557.534760:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111370240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789048557.534929:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048557.535077:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111370240 00000100:00100000:3.0:1789048557.535090:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111370240 00000100:00100000:3.0:1789048557.535157:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789048557.535171:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111370240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789048557.535231:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789048557.535306:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111370240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048557.535323:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789048557.535374:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111370240:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1789048557.640276:0:12873:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789048557.640624:0:12873:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789048558.045525:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789048558.045570:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111370368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789048558.045646:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111370496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048558.045664:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048558.045737:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111370368 00000100:00100000:2.0:1789048558.045747:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111370368 00000100:00100000:2.0:1789048558.045811:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789048558.045824:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111370368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789048558.045864:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048558.045924:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048558.046020:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111370496 00000100:00100000:0.0:1789048558.046025:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111370496 00000100:00100000:0.0:1789048558.046047:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789048558.046054:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111370496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789048558.046065:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048558.046099:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111370496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048558.046107:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1789048558.046149:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c2b610700 x1875953111370496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048558.046168:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111370496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048558.047400:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111370368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1569us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048558.047414:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:3.0:1789048558.047425:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d88700 x1875953111370368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048558.047450:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111370368:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789048558.557599:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048559.071414:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789048559.071452:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111370624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789048559.071567:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048559.071729:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111370624 00000100:00100000:1.0:1789048559.071741:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111370624 00000100:00100000:1.0:1789048559.071810:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789048559.071824:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111370624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789048559.071873:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789048559.071946:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111370624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048559.071954:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789048559.072246:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111370624:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789048559.581685:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048560.605707:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048560.708262:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048560.708470:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097656704 00000100:00100000:0.0:1789048560.708484:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097656704 00000100:00100000:0.0:1789048560.708593:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 318 00000100:00100000:0.0:1789048560.708606:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2394:x1875953097656704:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048560.708703:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2394:x1875953097656704:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 100us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048560.708712:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 318 00000100:00100000:1.0:1789048560.730472:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048560.730704:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097656832 00000100:00100000:2.0:1789048560.730717:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097656832 00000100:00100000:2.0:1789048560.730853:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 191 00000100:00100000:2.0:1789048560.730868:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08205180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097656832:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048560.730975:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08205180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097656832:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 111us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048560.730984:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 191 00000100:00080000:3.0:1789048560.735962:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789048560.736494:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048560.736660:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097657088 00000100:00100000:2.0:1789048560.736674:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097657088 00000100:00100000:2.0:1789048560.736805:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 192 00000100:00100000:2.0:1789048560.736836:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08206d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097657088:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048560.736943:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08206d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097657088:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 109us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048560.736957:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 192 00000100:00080000:3.0:1789048560.739102:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789048560.746221:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048560.746328:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048560.746653:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097656960 00000100:00100000:0.0:1789048560.746668:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097656960 00000100:00100000:0.0:1789048560.746835:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097657216 00000100:00100000:0.0:1789048560.746839:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097657216 00000100:00080000:3.0:1789048560.746916:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789048560.747205:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 193 00000100:00100000:2.0:1789048560.747222:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097656960:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048560.747367:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097656960:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 150us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048560.747375:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 193 00000100:00100000:2.0:1789048560.747408:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 194 00000100:00100000:2.0:1789048560.747416:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097657216:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048560.747443:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097657216:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 28us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048560.747450:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 194 00000001:00100000:1.0:1789048561.121791:0:9492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 433baedb-13e1-412e-b0c8-ceb1dbfcf502 00000020:00000080:1.0:1789048561.121801:0:9492:0:(genops.c:885:class_export_put()) final put ffff959c3fb41000/433baedb-13e1-412e-b0c8-ceb1dbfcf502 00000020:00000080:1.0:1789048561.121831:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3fb41000/433baedb-13e1-412e-b0c8-ceb1dbfcf502 for lustre-OST0001 00000020:00000080:1.0:1789048561.121877:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c3fb44000 for lustre-OST0001 00000001:00100000:2.0:1789048561.130215:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 433baedb-13e1-412e-b0c8-ceb1dbfcf502 00000020:00000080:2.0:1789048561.130224:0:8407:0:(genops.c:885:class_export_put()) final put ffff959c3fb90800/433baedb-13e1-412e-b0c8-ceb1dbfcf502 00000020:00000080:1.0:1789048561.130306:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3fb90800/433baedb-13e1-412e-b0c8-ceb1dbfcf502 for lustre-OST0000 00000020:00000080:1.0:1789048561.130413:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c3fb91800 for lustre-OST0000 00010000:00010000:2.0:1789048561.632169:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789048561.681097:0:13018:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1789048562.142114:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111370752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789048562.142202:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048562.142353:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111370752 00000100:00100000:2.0:1789048562.142362:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111370752 00000100:00100000:2.0:1789048562.142424:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789048562.142435:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111370752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789048562.142466:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789048562.142511:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111370752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048562.142545:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1789048562.143071:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789048562.143107:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d89880 x1875953111370752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048578 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048562.143145:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111370752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789048562.144382:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111370880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048562.144440:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048562.145266:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111370880 00000100:00100000:3.0:1789048562.145274:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111370880 00000100:00100000:3.0:1789048562.145358:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789048562.145367:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111370880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789048562.145387:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048562.145434:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111370880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048562.145441:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789048562.145517:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111371008:0@lo:400:kworker.0 00000100:00100000:0.0:1789048562.145566:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048562.145609:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111371520:0@lo:400:kworker.0 00000100:00100000:0.0:1789048562.145633:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048562.145649:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111372032:0@lo:400:kworker.0 00000100:00100000:0.0:1789048562.145671:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048562.145689:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789048562.145695:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111371136:0@lo:400:kworker.0 00000100:00100000:0.0:1789048562.145718:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048562.145732:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111371648:0@lo:400:kworker.0 00000100:00100000:0.0:1789048562.145747:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048562.145759:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111372160:0@lo:400:kworker.0 00000100:00100000:0.0:1789048562.145775:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048562.145802:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111371136 00000100:00100000:0.0:1789048562.145805:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111371136 00000100:00100000:0.0:1789048562.145834:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111371648 00000100:00100000:0.0:1789048562.145837:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111371648 00000100:00100000:0.0:1789048562.145869:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111372160 00000100:00100000:0.0:1789048562.145872:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111372160 00000100:00100000:0.0:1789048562.145887:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789048562.145894:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111371136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048562.145931:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111371136:12345-0@lo:400:kworker.0 Request processed in 38us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048562.145936:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789048562.145950:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789048562.145956:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111371648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048562.145982:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111371648:12345-0@lo:400:kworker.0 Request processed in 26us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048562.145989:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789048562.145999:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789048562.146005:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111372160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048562.146029:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111372160:12345-0@lo:400:kworker.0 Request processed in 25us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048562.146035:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789048562.146065:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111371136:0@lo:400:kworker.0 00000100:00100000:0.0:1789048562.146075:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111371648:0@lo:400:kworker.0 00000100:00100000:0.0:1789048562.146083:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111372160:0@lo:400:kworker.0 00000100:00100000:0.0:1789048562.146112:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111371264:0@lo:400:kworker.0 00000100:00100000:0.0:1789048562.146152:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048562.146168:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111371776:0@lo:400:kworker.0 00000100:00100000:0.0:1789048562.146185:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048562.146208:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111372288:0@lo:400:kworker.0 00000100:00100000:0.0:1789048562.146227:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048562.146238:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789048562.146243:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111371392:0@lo:400:kworker.0 00000100:00100000:0.0:1789048562.146258:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048562.146268:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111371904:0@lo:400:kworker.0 00000100:00100000:0.0:1789048562.146283:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048562.146302:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111371776 00000100:00100000:0.0:1789048562.146306:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111371776 00000100:00100000:0.0:1789048562.146322:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111372288 00000100:00100000:0.0:1789048562.146324:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111372288 00000100:00100000:0.0:1789048562.146368:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111371392 00000100:00100000:0.0:1789048562.146372:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111371392 00000100:00100000:0.0:1789048562.146385:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789048562.146391:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111371776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048562.146424:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111371776:12345-0@lo:400:kworker.0 Request processed in 33us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048562.146430:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789048562.146441:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789048562.146447:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111372288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048562.146471:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111372288:12345-0@lo:400:kworker.0 Request processed in 25us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048562.146477:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789048562.146488:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789048562.146494:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111371392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048562.146557:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111371392:12345-0@lo:400:kworker.0 Request processed in 26us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048562.146574:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789048562.146600:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111371392:0@lo:400:kworker.0 00010000:00080000:0.0:1789048562.146612:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d81f80 x1875953111371776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048562.146622:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111371776:0@lo:400:kworker.0 00010000:00080000:0.0:1789048562.146630:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d83480 x1875953111372288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048562.146637:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111372288:0@lo:400:kworker.0 00000100:00100000:3.0:1789048562.148761:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111371008 00000100:00100000:3.0:1789048562.148775:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111371008 00000100:00100000:3.0:1789048562.148834:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789048562.148843:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111371008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048562.148930:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111371008:12345-0@lo:400:kworker.0 Request processed in 87us (3363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048562.148937:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789048562.148988:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111371520 00000100:00100000:3.0:1789048562.148992:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111371520 00000100:00100000:3.0:1789048562.149014:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111371264 00000100:00100000:3.0:1789048562.149016:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111371264 00000100:00100000:3.0:1789048562.149028:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789048562.149034:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111371520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048562.149066:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111371520:12345-0@lo:400:kworker.0 Request processed in 32us (3432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048562.149072:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789048562.149083:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789048562.149089:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111371264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048562.149118:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111371264:12345-0@lo:400:kworker.0 Request processed in 30us (2966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048562.149124:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789048562.149732:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111372032 00000100:00100000:3.0:1789048562.149739:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111372032 00000100:00100000:3.0:1789048562.149770:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111371904 00000100:00100000:3.0:1789048562.149773:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111371904 00000100:00100000:3.0:1789048562.149793:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789048562.149799:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111372032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048562.149839:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111372032:12345-0@lo:400:kworker.0 Request processed in 40us (4167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048562.149845:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789048562.149857:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789048562.149862:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111371904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048562.149888:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111371904:12345-0@lo:400:kworker.0 Request processed in 26us (3604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048562.149905:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789048562.149948:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111371008:0@lo:400:kworker.0 00000100:00100000:3.0:1789048562.149962:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111371520:0@lo:400:kworker.0 00010000:00080000:3.0:1789048562.149975:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d81500 x1875953111372032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048562.149986:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111372032:0@lo:400:kworker.0 00010000:00080000:1.0:1789048562.150408:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c2b610a80 x1875953111370880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048578 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048562.150428:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111370880:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789048562.150529:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789048562.150534:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789048562.150537:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789048562.150540:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789048562.170430:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d80e00 x1875953111371904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048562.170448:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111371904:0@lo:400:kworker.0 00000100:00100000:0.0:1789048562.170463:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111371264:0@lo:400:kworker.0 00000100:00100000:1.0:1789048562.654408:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789048562.654433:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111372416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048562.654500:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048562.654674:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111372416 00000100:00100000:2.0:1789048562.654691:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111372416 00010000:00010000:3.0:1789048562.662252:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048562.662759:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789048562.662791:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111372416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789048562.662903:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789048562.663010:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111372416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 237us (8510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048562.663015:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789048562.663132:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111372416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048563.166654:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111372544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789048563.166752:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048563.167168:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111372544 00000100:00100000:0.0:1789048563.167180:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111372544 00000100:00100000:0.0:1789048563.167238:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789048563.167247:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111372544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789048563.167276:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048563.167319:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111372544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048563.167326:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:1.0:1789048563.167499:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0820c380 x1875953111372544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048563.167527:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111372544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789048563.167552:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789048563.167558:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111372672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789048563.167585:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048563.167725:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111372672 00000100:00100000:3.0:1789048563.167732:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111372672 00000100:00100000:3.0:1789048563.167769:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789048563.167782:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111372672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789048563.167795:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048563.167845:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111372672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048563.167855:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1789048563.168799:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08108a80 x1875953111372672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048563.168821:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111372672:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789048563.693605:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048564.195757:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111372800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789048564.195831:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048564.196038:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111372800 00000100:00100000:3.0:1789048564.196046:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111372800 00000100:00100000:3.0:1789048564.196094:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789048564.196102:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111372800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789048564.196133:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789048564.196182:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111372800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048564.196189:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789048564.196264:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111372800:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789048564.701589:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789048564.966713:0:13165:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe64876fd0 20000000:00000080:3.0:1789048564.966732:0:13165:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff959c3e85bc00 uarg=0000000000000000 20000000:01000000:3.0:1789048564.966784:0:13165:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789048564.966790:0:13165:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789048564.966795:0:13165:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789048564.968747:0:13166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1789048564.968985:0:13165:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789048564.980475:0:13165:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789048564.980526:0:13165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f12 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048564.980988:0:13165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c00030a00/0x133f221c08775ea2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2960d expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048564.980999:0:13165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c02837800/0x133f221c08775eb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775ea9 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048564.981006:0:13165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c00031200/0x133f221c08775ebe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775eb7 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048564.981013:0:13165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c3ef39800/0x133f221c08775ecc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775ec5 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048564.981019:0:13165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c00031a00/0x133f221c08775eda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775ed3 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048564.981027:0:13165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c3ef38e00/0x133f221c08775eef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2964c expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048564.981045:0:13165:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f12 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048564.981205:0:13165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c3ef38e00/0x133f221c08775eef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2964c expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048564.981241:0:13165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c3ef38e00/0x133f221c08775eef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2964c expref: 12 pid: 6490 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048564.981258:0:13165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1875953111372928:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048564.981506:0:13165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c00031a00/0x133f221c08775eda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775ed3 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048564.981523:0:13165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c00031a00/0x133f221c08775eda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775ed3 expref: 23 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048564.981534:0:13165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1875953111373056:0@lo:104: 00000100:00100000:3.0:1789048564.981593:0:13165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789048564.981637:0:13165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c3ef39800/0x133f221c08775ecc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775ec5 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048564.981645:0:13165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c3ef39800/0x133f221c08775ecc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775ec5 expref: 23 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048564.981653:0:13165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d89500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1875953111373184:0@lo:104: 00000100:00100000:3.0:1789048564.981673:0:13165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789048564.981712:0:13165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c00031200/0x133f221c08775ebe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775eb7 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048564.981720:0:13165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c00031200/0x133f221c08775ebe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775eb7 expref: 23 pid: 6490 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048564.981729:0:13165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07958000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1875953111373312:0@lo:104: 00000100:00100000:3.0:1789048564.981751:0:13165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789048564.981779:0:13165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c02837800/0x133f221c08775eb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775ea9 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048564.981788:0:13165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c02837800/0x133f221c08775eb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775ea9 expref: 23 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048564.981796:0:13165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0795b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1875953111373440:0@lo:104: 00000100:00100000:3.0:1789048564.981816:0:13165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048564.981986:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111373056 00000100:00100000:1.0:1789048564.982000:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111373056 00000100:00100000:1.0:1789048564.982051:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111373184 00000100:00100000:1.0:1789048564.982054:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111373184 00000100:00100000:1.0:1789048564.982067:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111373312 00000100:00100000:1.0:1789048564.982069:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111373312 00000100:00100000:1.0:1789048564.982080:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111373440 00000100:00100000:1.0:1789048564.982092:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111373440 00000100:00100000:1.0:1789048564.982107:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789048564.982115:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b610a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+6:13165:x1875953111373056:12345-0@lo:104: 00010000:00010000:1.0:1789048564.982127:0:8428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775ed3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775eda expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982180:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789048564.982187:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b610a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+6:13165:x1875953111373056:12345-0@lo:104: Request processed in 73us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048564.982194:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789048564.982210:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789048564.982216:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+5:13165:x1875953111373184:12345-0@lo:104: 00010000:00010000:1.0:1789048564.982222:0:8428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c3ef38200/0x133f221c08775ec5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775ecc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982254:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789048564.982259:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+5:13165:x1875953111373184:12345-0@lo:104: Request processed in 44us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048564.982265:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789048564.982278:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789048564.982285:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0795aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:13165:x1875953111373312:12345-0@lo:104: 00010000:00010000:1.0:1789048564.982292:0:8428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775eb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775ebe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982363:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789048564.982368:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0795aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:13165:x1875953111373312:12345-0@lo:104: Request processed in 86us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048564.982375:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789048564.982387:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789048564.982394:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07958700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:13165:x1875953111373440:12345-0@lo:104: 00010000:00010000:1.0:1789048564.982402:0:8428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c3ef3de00/0x133f221c08775ea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775eb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982427:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789048564.982432:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07958700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:13165:x1875953111373440:12345-0@lo:104: Request processed in 40us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048564.982437:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1789048564.982454:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789048564.982460:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775ed3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775eda expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982467:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c00030000 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048564.982471:0:7447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775ed3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775eda expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982479:0:7447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775ed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775eda expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048564.982487:0:7447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775ed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775eda expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048564.982503:0:7447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789048564.982538:0:7447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775ed3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775eda expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982545:0:7447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048564.982565:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775ed3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775eda expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982572:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c00030000/0x133f221c08775ed3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775eda expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982597:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789048564.982600:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef38200/0x133f221c08775ec5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775ecc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982605:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38200 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048564.982608:0:7447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef38200/0x133f221c08775ec5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775ecc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982615:0:7447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef38200/0x133f221c08775ec5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775ecc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048564.982621:0:7447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef38200/0x133f221c08775ec5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775ecc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048564.982625:0:7447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789048564.982638:0:7447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c3ef38200/0x133f221c08775ec5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775ecc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982644:0:7447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048564.982660:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef38200/0x133f221c08775ec5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775ecc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982677:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef38200/0x133f221c08775ec5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775ecc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982685:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789048564.982688:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775eb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775ebe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982693:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c00031800 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048564.982696:0:7447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775eb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775ebe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982702:0:7447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775eb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775ebe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048564.982708:0:7447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775eb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775ebe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048564.982713:0:7447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789048564.982726:0:7447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775eb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775ebe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982731:0:7447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048564.982738:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775eb7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775ebe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982744:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c00031800/0x133f221c08775eb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775ebe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982753:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048564.982761:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef3de00/0x133f221c08775ea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775eb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982767:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3de00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048564.982770:0:7447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3de00/0x133f221c08775ea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775eb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982776:0:7447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef3de00/0x133f221c08775ea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775eb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048564.982781:0:7447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3de00/0x133f221c08775ea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775eb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048564.982786:0:7447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789048564.982798:0:7447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c3ef3de00/0x133f221c08775ea9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775eb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982803:0:7447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048564.982809:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3de00/0x133f221c08775ea9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775eb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.982816:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef3de00/0x133f221c08775ea9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775eb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048564.983038:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048564.983040:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048564.983042:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048564.983050:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048564.983055:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048564.983077:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111373568:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789048564.983175:0:13165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c00030a00/0x133f221c08775ea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2960d expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048564.983187:0:13165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c00030a00/0x133f221c08775ea2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2960d expref: 12 pid: 6490 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048564.983197:0:13165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0795b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1875953111374080:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048564.983236:0:13165:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b98c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789048564.983258:0:13165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1875953111373056:0@lo:104: 00000100:00100000:3.0:1789048564.983267:0:13165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d89500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1875953111373184:0@lo:104: 00000100:00100000:3.0:1789048564.983274:0:13165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07958000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1875953111373312:0@lo:104: 00000100:00100000:3.0:1789048564.983281:0:13165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0795b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1875953111373440:0@lo:104: 00000100:00100000:1.0:1789048564.983457:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048564.983507:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789048564.987995:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111373696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048564.988074:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048564.988971:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111373952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789048564.989009:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048564.989559:0:13165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1875953111372928:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048564.989572:0:13165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0795b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1875953111374080:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048564.989621:0:13165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f12 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048564.989950:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111373824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789048564.989984:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048564.990917:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111373568 00000100:00100000:2.0:1789048564.990926:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111373568 00010000:00010000:2.0:1789048564.990963:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c00031a00/0x133f221c08775eda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775ed3 expref: 24 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048564.990985:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111373696 00000100:00100000:2.0:1789048564.990988:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111373696 00010000:00010000:2.0:1789048564.990998:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c3ef39800/0x133f221c08775ecc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775ec5 expref: 25 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048564.991021:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111373952 00000100:00100000:2.0:1789048564.991024:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111373952 00010000:00010000:2.0:1789048564.991047:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c02837800/0x133f221c08775eb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775ea9 expref: 26 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048564.991059:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111373824 00000100:00100000:2.0:1789048564.991061:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111373824 00010000:00010000:2.0:1789048564.991070:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c00031200/0x133f221c08775ebe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775eb7 expref: 27 pid: 6490 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048564.991092:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789048564.991100:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+27:3623:x1875953111373568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048564.991113:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048564.991118:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c00031a00/0x133f221c08775eda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775ed3 expref: 27 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048564.991128:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c00031a00/0x133f221c08775eda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775ed3 expref: 27 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048564.991144:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c00031a00/0x133f221c08775eda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775ed3 expref: 27 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048564.991160:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048564.991408:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+26:3623:x1875953111373568:12345-0@lo:103:ldlm_bl.0 Request processed in 308us (7950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048564.991417:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789048564.991434:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789048564.991441:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07958a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+25:3620:x1875953111373696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048564.991456:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048564.991461:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c3ef39800/0x133f221c08775ecc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775ec5 expref: 25 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048564.991481:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c3ef39800/0x133f221c08775ecc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775ec5 expref: 25 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048564.991501:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef39800/0x133f221c08775ecc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775ec5 expref: 25 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048564.991509:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048564.991747:0:6482:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789048564.991757:0:6482:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789048564.991924:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07958a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111373696:12345-0@lo:103:ldlm_bl.0 Request processed in 483us (3850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048564.991931:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789048564.991944:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789048564.991951:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:3623:x1875953111373952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048564.991959:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048564.991964:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c02837800/0x133f221c08775eb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775ea9 expref: 23 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048564.991973:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c02837800/0x133f221c08775eb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775ea9 expref: 23 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048564.991983:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c02837800/0x133f221c08775eb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775ea9 expref: 23 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048564.991992:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048564.992014:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:3623:x1875953111373952:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (3005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048564.992141:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789048564.992157:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789048564.992164:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:3621:x1875953111373824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048564.992172:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048564.992177:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c00031200/0x133f221c08775ebe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775eb7 expref: 21 pid: 6490 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048564.992185:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c00031200/0x133f221c08775ebe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775eb7 expref: 21 pid: 6490 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048564.992194:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c00031200/0x133f221c08775ebe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775eb7 expref: 21 pid: 6490 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048564.992203:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048564.992233:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:3621:x1875953111373824:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048564.992239:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789048564.992284:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111373824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048564.992314:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111373696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048564.992528:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111373568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048564.993286:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111373952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048564.997634:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048564.997670:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048564.997804:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097657344 00000100:00100000:0.0:1789048564.997814:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097657344 00010000:00010000:0.0:1789048564.997863:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c3ef38e00/0x133f221c08775eef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2964c expref: 13 pid: 6490 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048564.997895:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097657472 00000100:00100000:0.0:1789048564.997899:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097657472 00010000:00010000:0.0:1789048564.997910:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c00030a00/0x133f221c08775ea2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2960d expref: 14 pid: 6490 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048564.997944:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:0.0:1789048564.997954:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0795b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+14:2393:x1875953097657344:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048564.997971:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048564.997976:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c3ef38e00/0x133f221c08775eef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2964c expref: 14 pid: 6490 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048564.997988:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c3ef38e00/0x133f221c08775eef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2964c expref: 14 pid: 6490 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048564.998006:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef38e00/0x133f221c08775eef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2964c expref: 14 pid: 6490 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048564.998020:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048564.998069:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0795b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2393:x1875953097657344:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 115us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048564.998076:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:0.0:1789048564.998107:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:0.0:1789048564.998113:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2aece450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:2394:x1875953097657472:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048564.998121:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048564.998139:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c00030a00/0x133f221c08775ea2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2960d expref: 12 pid: 6490 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048564.998148:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c00030a00/0x133f221c08775ea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2960d expref: 12 pid: 6490 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048564.998158:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c00030a00/0x133f221c08775ea2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2960d expref: 12 pid: 6490 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048564.998170:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f12 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048564.998178:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f12 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048564.998192:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f12 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048564.998199:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f12 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048564.998205:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f12 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048564.998213:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f12 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048564.998219:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048564.998223:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f12 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048564.998231:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f12 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048564.998251:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f12 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048564.998261:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048564.998282:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2aece450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+11:2394:x1875953097657472:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 169us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048564.998289:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 45 00010000:00010000:3.0:1789048564.999402:0:13165:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f12 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048564.999415:0:13165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f12 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048564.999424:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f12 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048565.727846:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048565.832757:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048565.832805:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048565.832843:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048565.832893:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048565.833120:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097657600 00000100:00100000:2.0:1789048565.833136:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097657600 00000100:00100000:2.0:1789048565.833189:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097657856 00000100:00100000:2.0:1789048565.833191:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097657856 00000100:00100000:2.0:1789048565.833204:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097657728 00000100:00100000:2.0:1789048565.833207:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097657728 00000100:00100000:2.0:1789048565.833218:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097657984 00000100:00100000:2.0:1789048565.833233:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097657984 00000100:00100000:2.0:1789048565.833254:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 201 00000100:00100000:2.0:1789048565.833262:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0795b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2392:x1875953097657600:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048565.833325:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0795b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2392:x1875953097657600:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 64us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048565.833355:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 201 00000100:00100000:2.0:1789048565.833369:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 202 00000100:00100000:2.0:1789048565.833373:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2392:x1875953097657856:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048565.833387:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2392:x1875953097657856:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 15us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048565.833391:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 202 00000100:00100000:2.0:1789048565.833397:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 203 00000100:00100000:2.0:1789048565.833400:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0795a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2392:x1875953097657728:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048565.833411:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0795a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2392:x1875953097657728:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 11us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048565.833415:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 203 00000100:00100000:2.0:1789048565.833420:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 204 00000100:00100000:2.0:1789048565.833424:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0795a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2392:x1875953097657984:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048565.833435:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0795a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2392:x1875953097657984:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 12us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048565.833439:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 204 00000100:00080000:3.0:1789048565.835269:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789048565.835278:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789048566.269458:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048566.269580:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097658112 00000100:00100000:3.0:1789048566.269591:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097658112 00000100:00100000:3.0:1789048566.269667:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 320 00000100:00100000:3.0:1789048566.269678:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+11:6169:x1875953097658112:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048566.269701:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048566.269727:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b2967d expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048566.269762:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2967d expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048566.269793:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2967d expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048566.269803:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3c600, rc 0) 00000100:00100000:3.0:1789048566.269867:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:6169:x1875953097658112:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 191us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048566.269874:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 320 00000100:00100000:3.0:1789048566.275978:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048566.280110:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097658240 00000100:00100000:1.0:1789048566.280126:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097658240 00000100:00100000:1.0:1789048566.280203:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 321 00000100:00100000:1.0:1789048566.280215:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:6169:x1875953097658240:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048566.280398:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:6169:x1875953097658240:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 185us (4431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048566.280406:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 321 00000100:00100000:0.0:1789048566.287835:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048566.288793:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097658368 00000100:00100000:1.0:1789048566.288806:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097658368 00000100:00100000:1.0:1789048566.288888:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 322 00000100:00100000:1.0:1789048566.288898:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:6169:x1875953097658368:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048566.289558:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:6169:x1875953097658368:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 658us (1729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048566.289568:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 322 00000100:00100000:0.0:1789048566.303268:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048566.303517:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097658496 00000100:00100000:3.0:1789048566.303537:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097658496 00000100:00100000:3.0:1789048566.303595:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 323 00000100:00100000:3.0:1789048566.303605:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:6169:x1875953097658496:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048566.303622:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048566.303639:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef3dc00/0x133f221c08775f20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29684 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048566.303666:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3dc00/0x133f221c08775f20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29684 expref: 13 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048566.303676:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef3dc00/0x133f221c08775f20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29684 expref: 13 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048566.303685:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3dc00, rc 0) 00000100:00100000:3.0:1789048566.303744:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:6169:x1875953097658496:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 140us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048566.303752:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 323 00000100:00100000:3.0:1789048566.313974:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048566.314150:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097658624 00000100:00100000:1.0:1789048566.314160:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097658624 00000100:00100000:1.0:1789048566.314216:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 324 00000100:00100000:1.0:1789048566.314226:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:6169:x1875953097658624:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048566.314395:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:6169:x1875953097658624:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 169us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048566.314421:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 324 00000100:00100000:0.0:1789048566.317716:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048566.317818:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097658752 00000100:00100000:2.0:1789048566.317827:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097658752 00000100:00100000:2.0:1789048566.317896:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 325 00000100:00100000:2.0:1789048566.317906:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:6169:x1875953097658752:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048566.318062:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:6169:x1875953097658752:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 149us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048566.318071:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 325 00010000:00010000:1.0:1789048566.757430:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789048566.946841:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789048566.946852:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959b06952000 from 7 10000000:01000000:2.0:1789048566.946858:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789048566.946902:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775f27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048566.946915:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775f27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048566.946927:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775f27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048566.946959:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111374208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789048566.947050:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048566.947863:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88240 going to sleep for 11 seconds 00000100:00100000:3.0:1789048566.960008:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111374208 00000100:00100000:3.0:1789048566.960025:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111374208 00000100:00100000:3.0:1789048566.960095:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789048566.960105:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:6494:x1875953111374208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048566.960123:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048566.960142:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef3ce00/0x133f221c08775f2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775f27 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048566.960167:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3ce00/0x133f221c08775f2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775f27 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048566.960178:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef3ce00/0x133f221c08775f2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775f27 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048566.960188:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3ce00, rc 0) 00000100:00100000:3.0:1789048566.960255:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111374208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (13206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048566.960261:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789048566.960324:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111374208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048566.960358:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775f27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775f2e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048566.960368:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775f27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775f2e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048566.960437:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07958380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111374336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048566.960469:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048566.960526:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b98780 going to sleep for 11 seconds 00000100:00100000:0.0:1789048566.960589:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111374336 00000100:00100000:0.0:1789048566.960594:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111374336 00000100:00100000:0.0:1789048566.960624:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789048566.960631:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111374336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048566.960731:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111374336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048566.960738:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1789048566.960797:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07958380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111374336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048566.960828:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07958380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111374464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789048566.960947:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048566.961001:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b98780 going to sleep for 11 seconds 00000100:00100000:0.0:1789048566.961285:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111374464 00000100:00100000:0.0:1789048566.961290:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111374464 00000100:00100000:0.0:1789048566.961321:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789048566.961327:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111374464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789048566.961441:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111374464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048566.961448:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789048566.961601:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07958380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111374464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789048566.962549:0:13198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789048566.963792:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789048566.963824:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789048566.963843:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775f27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775f2e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048566.963856:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775f27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775f2e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048566.963866:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789048566.963878:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c41779800 from 7 10000000:01000000:2.0:1789048566.963882:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789048566.963919:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775f35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048566.963927:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775f35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048566.963937:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775f35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048566.963960:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111374592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789048566.964028:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048566.964072:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b880c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048566.964389:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111374592 00000100:00100000:0.0:1789048566.964401:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111374592 00000100:00100000:0.0:1789048566.964445:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1789048566.964453:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111374592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789048566.964466:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048566.964496:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef39600/0x133f221c08775f3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775f35 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048566.964518:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef39600/0x133f221c08775f3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775f35 expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048566.964527:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef39600/0x133f221c08775f3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775f35 expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048566.964534:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39600, rc 0) 00000100:00100000:0.0:1789048566.964570:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111374592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048566.964575:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789048566.965624:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111374592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048566.965644:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775f35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775f3c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048566.965654:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775f35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775f3c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048566.965719:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111374720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048566.965756:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048566.965788:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b880c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048566.965925:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111374720 00000100:00100000:0.0:1789048566.965930:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111374720 00000100:00100000:0.0:1789048566.965961:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1789048566.965968:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111374720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048566.966072:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111374720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048566.966078:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789048566.966134:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111374720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048566.966160:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111374848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048566.966193:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048566.966212:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b880c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048566.966252:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111374848 00000100:00100000:3.0:1789048566.966257:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111374848 00000100:00100000:3.0:1789048566.966285:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1789048566.966291:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111374848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789048566.966400:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111374848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048566.966407:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789048566.966599:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111374848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789048566.971046:0:13199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789048566.972044:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789048566.972075:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789048566.972085:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775f35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775f3c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048566.972113:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775f35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775f3c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048566.972137:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789048566.972140:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c414c7000 from 7 10000000:01000000:0.0:1789048566.972142:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789048566.972181:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08775f43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048566.972189:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08775f43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048566.972200:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08775f43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048566.972225:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111374976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789048566.972719:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048566.972767:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b081139c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048566.972814:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111374976 00000100:00100000:1.0:1789048566.972821:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111374976 00000100:00100000:1.0:1789048566.972879:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789048566.972888:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111374976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048566.972901:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048566.972915:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba1c00/0x133f221c08775f4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775f43 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048566.972936:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba1c00/0x133f221c08775f4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775f43 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048566.972946:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba1c00/0x133f221c08775f4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775f43 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048566.972955:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1c00, rc 0) 00000100:00100000:1.0:1789048566.972995:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111374976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048566.973002:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789048566.973044:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111374976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048566.973057:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08775f43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775f4a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048566.973066:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08775f43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775f4a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048566.973125:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111375104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048566.973158:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048566.973173:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789048566.973184:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111375104 00000100:00100000:1.0:1789048566.973188:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111375104 00000100:00100000:1.0:1789048566.973209:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1789048566.973214:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111375104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048566.973309:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111375104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048566.973315:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1789048566.973367:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111375104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048566.973392:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111375232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048566.973428:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048566.973440:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789048566.973450:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111375232 00000100:00100000:1.0:1789048566.973453:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111375232 00000100:00100000:1.0:1789048566.973471:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1789048566.973504:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111375232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048566.973570:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111375232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048566.973576:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1789048566.973611:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111375232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789048566.978154:0:13200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789048566.979009:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789048566.979042:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789048566.979054:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08775f43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775f4a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048566.979089:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08775f43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775f4a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048566.979101:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789048566.979104:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c335d0800 from 7 10000000:01000000:1.0:1789048566.979106:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789048566.979143:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba1e00/0x133f221c08775f51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048566.979151:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b07ba1e00/0x133f221c08775f51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048566.979161:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b07ba1e00/0x133f221c08775f51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048566.979185:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111375360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789048566.979255:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048566.979547:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1789048566.979677:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111375360 00000100:00100000:2.0:1789048566.979685:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111375360 00000100:00100000:2.0:1789048566.979758:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789048566.979767:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111375360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048566.979779:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048566.979791:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c02837e00/0x133f221c08775f58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08775f51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048566.979812:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c02837e00/0x133f221c08775f58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08775f51 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048566.979821:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c02837e00/0x133f221c08775f58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775f51 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048566.979830:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02837e00, rc 0) 00000100:00100000:2.0:1789048566.979946:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:6494:x1875953111375360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048566.979954:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1789048566.980017:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111375360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048566.980031:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b07ba1e00/0x133f221c08775f51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775f58 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048566.980040:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b07ba1e00/0x133f221c08775f51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775f58 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048566.980095:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0795ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111375488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048566.980119:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048566.980186:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b98000 going to sleep for 11 seconds 00000100:00100000:1.0:1789048566.980243:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111375488 00000100:00100000:1.0:1789048566.980248:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111375488 00000100:00100000:1.0:1789048566.980268:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1789048566.980273:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:6494:x1875953111375488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048566.980454:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:6494:x1875953111375488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048566.980461:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1789048566.980586:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0795ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111375488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048566.980622:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08109c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111375616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048566.980666:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048566.980680:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048566.980690:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111375616 00000100:00100000:1.0:1789048566.980694:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111375616 00000100:00100000:1.0:1789048566.980709:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1789048566.980715:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:6494:x1875953111375616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048566.980778:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:6494:x1875953111375616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048566.980784:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1789048566.980816:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08109c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111375616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789048566.981630:0:13201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789048566.981685:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789048566.981704:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789048566.981713:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba1e00/0x133f221c08775f51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775f58 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048566.981723:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b07ba1e00/0x133f221c08775f51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775f58 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048567.261655:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789048567.261690:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111375744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048567.261771:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048567.261871:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111375744 00000100:00100000:3.0:1789048567.261878:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111375744 00000100:00100000:3.0:1789048567.261929:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789048567.261939:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111375744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789048567.261968:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048567.262012:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111375744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048567.262019:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1789048567.262054:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789048567.262084:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07959500 x1875953111375744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048583 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048567.262101:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111375744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048567.263126:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111376256:0@lo:400:kworker.0 00000100:00100000:1.0:1789048567.263160:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048567.263179:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111376768:0@lo:400:kworker.0 00000100:00100000:1.0:1789048567.263201:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048567.263216:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111377280:0@lo:400:kworker.0 00000100:00100000:1.0:1789048567.263232:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048567.263244:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789048567.263256:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111376128:0@lo:400:kworker.0 00000100:00100000:1.0:1789048567.263272:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048567.263281:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111376640:0@lo:400:kworker.0 00000100:00100000:1.0:1789048567.263291:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048567.263298:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111377152:0@lo:400:kworker.0 00000100:00100000:1.0:1789048567.263308:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048567.263327:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111376256 00000100:00100000:1.0:1789048567.263368:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111376256 00000100:00100000:1.0:1789048567.263405:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111376640 00000100:00100000:1.0:1789048567.263408:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111376640 00000100:00100000:1.0:1789048567.263429:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111377152 00000100:00100000:1.0:1789048567.263432:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111377152 00000100:00100000:1.0:1789048567.263445:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789048567.263450:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111376256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048567.263519:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111376256:12345-0@lo:400:kworker.0 Request processed in 68us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048567.263654:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111375872:0@lo:400:kworker.0 00000100:00100000:2.0:1789048567.263684:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048567.263710:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111376384:0@lo:400:kworker.0 00000100:00100000:2.0:1789048567.263729:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048567.263743:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111376896:0@lo:400:kworker.0 00000100:00100000:2.0:1789048567.263761:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048567.263785:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789048567.263790:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111376000:0@lo:400:kworker.0 00000100:00100000:2.0:1789048567.263822:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048567.263933:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111376512:0@lo:400:kworker.0 00000100:00100000:2.0:1789048567.263956:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048567.263966:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111377024:0@lo:400:kworker.0 00000100:00100000:2.0:1789048567.263980:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048567.263998:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111376000 00000100:00100000:2.0:1789048567.264001:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111376000 00000100:00100000:2.0:1789048567.264020:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111376512 00000100:00100000:2.0:1789048567.264022:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111376512 00000100:00100000:2.0:1789048567.264033:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111377024 00000100:00100000:2.0:1789048567.264035:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111377024 00000100:00100000:2.0:1789048567.264048:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789048567.264054:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111376640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048567.264083:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111376640:12345-0@lo:400:kworker.0 Request processed in 29us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048567.264089:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789048567.264102:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789048567.264107:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111377152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048567.264125:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111377152:12345-0@lo:400:kworker.0 Request processed in 19us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048567.264130:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789048567.264138:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789048567.264143:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111376000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048567.264170:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111376000:12345-0@lo:400:kworker.0 Request processed in 27us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048567.264185:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789048567.264198:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789048567.264203:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111376512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048567.264228:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111376512:12345-0@lo:400:kworker.0 Request processed in 25us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048567.264233:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789048567.264243:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789048567.264249:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111377024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048567.264271:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111377024:12345-0@lo:400:kworker.0 Request processed in 22us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048567.264276:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789048567.264295:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111375872 00000100:00100000:2.0:1789048567.264299:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111375872 00000100:00100000:2.0:1789048567.264323:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789048567.264329:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111375872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048567.264411:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111375872:12345-0@lo:400:kworker.0 Request processed in 83us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048567.264417:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789048567.264458:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111376000:0@lo:400:kworker.0 00000100:00100000:2.0:1789048567.264468:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111376512:0@lo:400:kworker.0 00000100:00100000:2.0:1789048567.267661:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111377024:0@lo:400:kworker.0 00000100:00100000:2.0:1789048567.267674:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111375872:0@lo:400:kworker.0 00000100:00100000:2.0:1789048567.267764:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111377408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048567.268012:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111376768 00000100:00100000:3.0:1789048567.268019:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111376768 00000100:00100000:3.0:1789048567.268068:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111377280 00000100:00100000:3.0:1789048567.268072:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111377280 00000100:00100000:3.0:1789048567.268088:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111376896 00000100:00100000:3.0:1789048567.268091:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111376896 00000100:00100000:3.0:1789048567.268108:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789048567.268117:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111376768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048567.268184:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111376768:12345-0@lo:400:kworker.0 Request processed in 69us (4982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048567.268191:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789048567.268209:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789048567.268214:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111377280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048567.268243:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111377280:12345-0@lo:400:kworker.0 Request processed in 29us (5009us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048567.268258:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789048567.268269:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789048567.268275:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111376896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048567.268301:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111376896:12345-0@lo:400:kworker.0 Request processed in 26us (4539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048567.268306:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789048567.268327:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111376128 00000100:00100000:3.0:1789048567.268346:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111376128 00000100:00100000:3.0:1789048567.268371:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111376384 00000100:00100000:3.0:1789048567.268374:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111376384 00000100:00100000:3.0:1789048567.268387:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789048567.268392:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111376128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048567.268423:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111376128:12345-0@lo:400:kworker.0 Request processed in 31us (5149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048567.268429:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789048567.268440:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789048567.268446:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111376384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048567.268774:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111376384:12345-0@lo:400:kworker.0 Request processed in 328us (5043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048567.268782:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:3.0:1789048567.268822:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789048567.268826:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789048567.268828:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789048567.269973:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789048567.270044:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111376128:0@lo:400:kworker.0 00010000:00080000:1.0:1789048567.270060:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08108000 x1875953111376640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048567.270072:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111376640:0@lo:400:kworker.0 00010000:00080000:1.0:1789048567.270084:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb2f100 x1875953111377152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048567.270093:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111377152:0@lo:400:kworker.0 00000100:00100000:1.0:1789048567.270105:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111376256:0@lo:400:kworker.0 00010000:00080000:1.0:1789048567.270126:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08108a80 x1875953111376768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048567.270134:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111376768:0@lo:400:kworker.0 00010000:00080000:1.0:1789048567.270145:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb2ca80 x1875953111377280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048567.270152:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111377280:0@lo:400:kworker.0 00000100:00080000:3.0:1789048567.270235:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789048567.272956:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048567.273016:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111376384:0@lo:400:kworker.0 00010000:00080000:2.0:1789048567.273032:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08108e00 x1875953111376896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048567.273044:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111376896:0@lo:400:kworker.0 00000100:00100000:1.0:1789048567.273194:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111377408 00000100:00100000:1.0:1789048567.273201:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111377408 00000100:00100000:1.0:1789048567.273252:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789048567.273262:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111377408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789048567.273287:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048567.273358:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111377408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048567.273365:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1789048567.273514:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d80e00 x1875953111377408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048583 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048567.273956:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111377408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048567.773699:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111377536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048567.773770:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048567.774007:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111377536 00000100:00100000:0.0:1789048567.774016:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111377536 00000100:00100000:0.0:1789048567.774068:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789048567.774077:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111377536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789048567.774122:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789048567.774171:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111377536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048567.774179:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789048567.774316:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111377536:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789048567.774605:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048568.289750:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789048568.289773:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111377664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789048568.289840:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048568.290117:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111377664 00000100:00100000:3.0:1789048568.290125:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111377664 00000100:00100000:3.0:1789048568.290181:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789048568.290200:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111377664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789048568.290228:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048568.290276:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111377664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048568.290283:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:3.0:1789048568.290321:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d83100 x1875953111377664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048568.290361:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111377664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048568.294593:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789048568.294631:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111377792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048568.294700:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048568.294945:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111377792 00000100:00100000:2.0:1789048568.294953:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111377792 00000100:00100000:2.0:1789048568.295006:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789048568.295017:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07959500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111377792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789048568.295037:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789048568.295088:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07959500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111377792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048568.295095:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1789048568.295774:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0820df80 x1875953111377792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048568.295810:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111377792:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789048568.797502:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048569.311906:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789048569.311931:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0795b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111377920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048569.312001:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048569.312057:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111377920 00000100:00100000:3.0:1789048569.312065:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111377920 00000100:00100000:3.0:1789048569.312106:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789048569.312114:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111377920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789048569.312146:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789048569.312186:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111377920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048569.312194:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789048569.312234:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0795b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111377920:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789048569.823540:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789048570.185100:0:13365:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789048570.845625:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048570.943397:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048570.943461:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048570.943558:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097658880 00000100:00100000:2.0:1789048570.943568:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097658880 00000100:00100000:2.0:1789048570.943631:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 339 00000100:00100000:2.0:1789048570.943641:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2393:x1875953097658880:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048570.943712:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2393:x1875953097658880:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 74us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048570.943720:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 339 00000100:00100000:0.0:1789048570.944421:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048570.956390:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048570.961889:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097659136 00000100:00100000:3.0:1789048570.961907:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097659136 00000100:00100000:0.0:1789048570.961992:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048570.961995:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097659392 00000100:00100000:3.0:1789048570.961998:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097659392 00000100:00100000:3.0:1789048570.962015:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097659008 00000100:00100000:3.0:1789048570.962018:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097659008 00000100:00100000:3.0:1789048570.962029:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097659264 00000100:00100000:3.0:1789048570.962031:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097659264 00000100:00100000:3.0:1789048570.962046:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 211 00000100:00100000:3.0:1789048570.962055:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097659136:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048570.962131:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097659136:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 76us (18670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048570.962864:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 212 00000100:00100000:0.0:1789048570.962877:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097659392:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048570.962925:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097659392:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 53us (18505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048570.962932:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 212 00000100:00100000:0.0:1789048570.962953:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 213 00000100:00100000:0.0:1789048570.962960:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097659008:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048570.962984:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097659008:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 25us (6605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048570.962990:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 213 00000100:00100000:0.0:1789048570.963315:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 214 00000100:00100000:0.0:1789048570.963324:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097659264:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048570.963372:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097659264:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 48us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048570.963380:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 214 00000100:00080000:0.0:1789048570.963402:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789048570.963418:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048570.971405:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 211 00010000:00010000:3.0:1789048571.876593:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048572.381924:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0795b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111378048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048572.382027:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048572.382591:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111378048 00000100:00100000:2.0:1789048572.382603:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111378048 00000100:00100000:2.0:1789048572.382672:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789048572.382684:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07958e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111378048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789048572.382724:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789048572.382785:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07958e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111378048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048572.382792:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:2.0:1789048572.382846:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0795b800 x1875953111378048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048588 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048572.382868:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0795b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111378048:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789048572.384161:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789048572.384164:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789048572.384183:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111378176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048572.384246:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048572.384302:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111378176 00000100:00100000:2.0:1789048572.384310:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111378176 00000100:00100000:2.0:1789048572.384410:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789048572.384448:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111378176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789048572.384472:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789048572.384514:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111378176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048572.384522:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:2.0:1789048572.384574:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0820e680 x1875953111378176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048588 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048572.384592:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111378176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048572.384753:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111378304:0@lo:400:kworker.0 00000100:00100000:2.0:1789048572.384787:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789048572.384788:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789048572.384809:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111378816:0@lo:400:kworker.0 00000100:00100000:0.0:1789048572.384815:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111378560:0@lo:400:kworker.0 00000100:00100000:2.0:1789048572.384837:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048572.384861:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048572.384864:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111379328:0@lo:400:kworker.0 00000100:00100000:0.0:1789048572.384882:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111379072:0@lo:400:kworker.0 00000100:00100000:2.0:1789048572.384889:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048572.384907:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789048572.384907:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048572.384911:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111378688:0@lo:400:kworker.0 00000100:00100000:0.0:1789048572.384922:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111379584:0@lo:400:kworker.0 00000100:00100000:2.0:1789048572.384930:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048572.384946:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111378816 00000100:00100000:2.0:1789048572.384950:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111379200:0@lo:400:kworker.0 00000100:00100000:0.0:1789048572.384950:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111378816 00000100:00100000:2.0:1789048572.384970:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048572.384982:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111378560 00000100:00100000:0.0:1789048572.384985:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111378560 00000100:00100000:2.0:1789048572.384995:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111378304 00000100:00100000:2.0:1789048572.384998:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111378304 00000100:00100000:0.0:1789048572.385002:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789048572.385007:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111378816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048572.385024:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789048572.385030:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3623:x1875953111378304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048572.385050:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111378816:12345-0@lo:400:kworker.0 Request processed in 42us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048572.385054:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3623:x1875953111378304:12345-0@lo:400:kworker.0 Request processed in 25us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048572.385057:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789048572.385065:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789048572.385071:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789048572.385077:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111378560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048572.385096:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111379328 00000100:00100000:2.0:1789048572.385100:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111379328 00000100:00100000:0.0:1789048572.385103:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111378560:12345-0@lo:400:kworker.0 Request processed in 27us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048572.385109:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789048572.385126:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111379072 00000100:00100000:2.0:1789048572.385129:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111379200 00000100:00100000:0.0:1789048572.385129:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111379072 00000100:00100000:2.0:1789048572.385131:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111379200 00000100:00100000:2.0:1789048572.385151:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789048572.385155:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111378688 00000100:00100000:2.0:1789048572.385157:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111379328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048572.385157:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111378688 00000100:00100000:0.0:1789048572.385178:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789048572.385184:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111379072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048572.385187:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111379328:12345-0@lo:400:kworker.0 Request processed in 31us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048572.385193:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789048572.385205:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789048572.385210:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111379200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048572.385217:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111379072:12345-0@lo:400:kworker.0 Request processed in 34us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048572.385224:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789048572.385232:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111379200:12345-0@lo:400:kworker.0 Request processed in 23us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048572.385235:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789048572.385237:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789048572.385240:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111378688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048572.385264:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111378688:12345-0@lo:400:kworker.0 Request processed in 23us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048572.385269:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:0.0:1789048572.385294:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789048572.385297:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789048572.385307:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048572.385368:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111378560:0@lo:400:kworker.0 00010000:00080000:0.0:1789048572.385381:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0747f800 x1875953111379072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048572.385391:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111379072:0@lo:400:kworker.0 00000100:00100000:3.0:1789048572.385531:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111379584 00000100:00100000:3.0:1789048572.385536:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111379584 00000100:00100000:3.0:1789048572.385570:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789048572.385577:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111379584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048572.385614:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111379584:12345-0@lo:400:kworker.0 Request processed in 38us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048572.385621:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789048572.385939:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789048572.385954:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111378432:0@lo:400:kworker.0 00000100:00100000:0.0:1789048572.385985:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048572.386000:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111378688:0@lo:400:kworker.0 00000100:00100000:0.0:1789048572.386011:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111378944:0@lo:400:kworker.0 00010000:00080000:3.0:1789048572.386013:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0747e300 x1875953111379200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048572.386022:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111379200:0@lo:400:kworker.0 00000100:00100000:0.0:1789048572.386031:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789048572.386033:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0747d500 x1875953111379328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048572.386046:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875953111379456:0@lo:400:kworker.0 00000100:00100000:3.0:1789048572.386051:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111379328:0@lo:400:kworker.0 00000100:00100000:3.0:1789048572.386061:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111378304:0@lo:400:kworker.0 00000100:00100000:0.0:1789048572.386066:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048572.386072:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111378816:0@lo:400:kworker.0 00010000:00080000:0.0:1789048572.386085:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0747ca80 x1875953111379584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048572.386094:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111379584:0@lo:400:kworker.0 00000100:00100000:3.0:1789048572.386105:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111378432 00000100:00100000:3.0:1789048572.386108:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111378432 00000100:00100000:0.0:1789048572.386119:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111378944 00000100:00100000:0.0:1789048572.386123:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111378944 00000100:00100000:3.0:1789048572.386125:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111379456 00000100:00100000:3.0:1789048572.386127:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111379456 00000100:00100000:3.0:1789048572.386140:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789048572.386146:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111378432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048572.386249:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111378432:12345-0@lo:400:kworker.0 Request processed in 102us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048572.386410:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789048572.386428:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111378944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048572.386461:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111378944:12345-0@lo:400:kworker.0 Request processed in 45us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048572.387322:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789048572.387392:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789048572.387405:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875953111379456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048572.387491:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875953111379456:12345-0@lo:400:kworker.0 Request processed in 92us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048572.387498:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:0.0:1789048572.387525:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789048572.387531:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789048572.387571:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111378432:0@lo:400:kworker.0 00000100:00100000:0.0:1789048572.387763:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111378944:0@lo:400:kworker.0 00000100:00100000:0.0:1789048572.387777:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875953111379456:0@lo:400:kworker.0 00000100:00100000:3.0:1789048572.390502:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789048572.893569:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789048572.893740:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111379712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048572.893855:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048572.895781:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111379712 00000100:00100000:0.0:1789048572.895800:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111379712 00000100:00100000:0.0:1789048572.895882:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789048572.895890:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111379712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789048572.895934:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789048572.896029:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111379712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (2175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048572.896036:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789048572.896093:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111379712:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789048572.905271:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048573.406369:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789048573.406400:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111379840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789048573.406504:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048573.406580:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111379840 00000100:00100000:0.0:1789048573.406590:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111379840 00000100:00100000:0.0:1789048573.406651:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789048573.406661:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111379840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789048573.406700:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048573.406754:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111379840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048573.406760:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:0.0:1789048573.406812:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08108a80 x1875953111379840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048573.406834:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111379840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789048573.407174:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111379968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789048573.407206:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048573.407966:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111379968 00000100:00100000:2.0:1789048573.407976:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111379968 00000100:00100000:2.0:1789048573.408033:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789048573.408043:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111379968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789048573.408065:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789048573.408123:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111379968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048573.408151:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1789048573.408292:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0810b100 x1875953111379968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048573.408310:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111379968:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789048573.918168:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048574.429572:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789048574.429603:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111380096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048574.429692:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048574.429789:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111380096 00000100:00100000:3.0:1789048574.429798:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111380096 00000100:00100000:3.0:1789048574.429855:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789048574.429865:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111380096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789048574.429907:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789048574.429961:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111380096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048574.429969:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789048574.430024:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111380096:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789048574.951546:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048575.966024:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048576.076753:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048576.076820:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048576.076850:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048576.076874:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048576.076919:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048576.076958:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097659776 00000100:00100000:1.0:1789048576.076970:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097659776 00000100:00100000:1.0:1789048576.077047:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097660032 00000100:00100000:1.0:1789048576.077050:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097660032 00000100:00100000:1.0:1789048576.077069:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097659648 00000100:00100000:1.0:1789048576.077072:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097659648 00000100:00100000:1.0:1789048576.077097:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097659904 00000100:00100000:1.0:1789048576.077100:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097659904 00000100:00100000:1.0:1789048576.077120:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 221 00000100:00100000:1.0:1789048576.077132:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097659776:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048576.077226:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097659776:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 94us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048576.077235:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 221 00000100:00100000:1.0:1789048576.077257:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 222 00000100:00100000:1.0:1789048576.077265:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097660032:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048576.077291:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097660032:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048576.077297:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 222 00000100:00100000:1.0:1789048576.077309:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 223 00000100:00100000:1.0:1789048576.077316:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097659648:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048576.077382:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097659648:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 66us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048576.077401:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 223 00000100:00100000:1.0:1789048576.077413:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 224 00000100:00100000:1.0:1789048576.077421:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097659904:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048576.077467:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097659904:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 46us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048576.077474:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 224 00000100:00100000:2.0:1789048576.077589:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097659520 00000100:00100000:2.0:1789048576.077594:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097659520 00000100:00100000:2.0:1789048576.077632:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 341 00000100:00100000:2.0:1789048576.077639:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2394:x1875953097659520:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048576.077667:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2394:x1875953097659520:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 30us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048576.077673:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 341 00000100:00080000:0.0:1789048576.078757:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789048576.078766:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:3.0:1789048576.722179:0:13514:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 09:56:15 (1789048575) === 00000100:00100000:1.0:1789048576.999676:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048576.999731:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048576.999787:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097660288 00000100:00100000:1.0:1789048576.999799:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097660288 00000100:00100000:1.0:1789048576.999870:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:1.0:1789048576.999882:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:10500:x1875953097660288:12345-192.168.202.16@tcp:700:mkdir.0 00000100:00100000:1.0:1789048576.999990:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:10500:x1875953097660288:12345-192.168.202.16@tcp:700:mkdir.0 Request processed in 111us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048576.999999:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:2.0:1789048577.000367:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097660160 00000100:00100000:2.0:1789048577.000372:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097660160 00000100:00100000:2.0:1789048577.000552:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:2.0:1789048577.000563:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2392:x1875953097660160:12345-192.168.202.16@tcp:41:mkdir.0 00000004:00000024:2.0:1789048577.000593:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789048577.000685:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2392:x1875953097660160:12345-192.168.202.16@tcp:41:mkdir.0 Request processed in 126us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048577.000693:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00010000:00010000:0.0:1789048577.002660:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048577.005709:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048577.006764:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097660544 00000100:00100000:2.0:1789048577.006776:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097660544 00000100:00100000:2.0:1789048577.006844:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:2.0:1789048577.006854:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:10500:x1875953097660544:12345-192.168.202.16@tcp:36:mkdir.0 00010000:00010000:2.0:1789048577.006906:0:8649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048577.006989:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08775e01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b295f8 expref: 6 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.007009:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c05322500) 00010000:00010000:2.0:1789048577.007033:0:8649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789048577.007111:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837200/0x133f221c08775f5f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.007125:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837200/0x133f221c08775f5f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.007135:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837200/0x133f221c08775f5f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.009549:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08775f66 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.009573:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08775f66 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.010187:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08775f66 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.013688:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08775f6d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.013710:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08775f6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.013723:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08775f6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789048577.013743:0:8649:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000431dda48 reply state 000000008ce9d230 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08775f6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.013754:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08775f6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.013775:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff959c05322400) 00010000:00010000:2.0:1789048577.013778:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789048577.013784:0:8649:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789048577.013791:0:8649:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789048577.013802:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837200/0x133f221c08775f5f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.013810:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837200/0x133f221c08775f5f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.013818:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837200/0x133f221c08775f5f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.013825:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048577.013830:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837200/0x133f221c08775f5f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.013838:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837200/0x133f221c08775f5f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.013848:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c05322900) 00010000:00010000:2.0:1789048577.013851:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048577.013854:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837200/0x133f221c08775f5f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.013860:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837200/0x133f221c08775f5f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789048577.013881:0:8649:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000431dda48 reply state 000000008ce9d230 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08775f66 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.013902:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08775f66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.013910:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff959c05322c00) 00010000:00010000:2.0:1789048577.013912:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789048577.013915:0:8649:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789048577.014015:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:10500:x1875953097660544:12345-192.168.202.16@tcp:36:mkdir.0 Request processed in 7159us (8313us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789048577.014025:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:3.0:1789048577.029750:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048577.033425:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097660672 00000100:00100000:0.0:1789048577.033442:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097660672 00000100:00100000:0.0:1789048577.033516:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:0.0:1789048577.033527:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:10501:x1875953097660672:12345-192.168.202.16@tcp:101:chmod.0 00010000:00010000:0.0:1789048577.033558:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048577.034430:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08775f74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2968b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.034503:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08775f7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.034515:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08775f7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.034529:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08775f7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048577.034589:0:6499:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789048577.034594:0:6499:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789048577.034631:0:6499:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08775f7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.034658:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08775f74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2968b expref: 9 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.034677:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08775f7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2968b expref: 8 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.034687:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c4151a800) 00010000:00010000:0.0:1789048577.034690:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789048577.034694:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38400, rc 0) 00000100:00100000:0.0:1789048577.034757:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:10501:x1875953097660672:12345-192.168.202.16@tcp:101:chmod.0 Request processed in 1232us (5020us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048577.034765:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:1.0:1789048577.066629:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048577.068690:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097660928 00000100:00100000:0.0:1789048577.068720:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097660928 00000100:00100000:0.0:1789048577.068813:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:0.0:1789048577.068827:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:10501:x1875953097660928:12345-192.168.202.16@tcp:36:chmod.0 00010000:00010000:0.0:1789048577.068902:0:12131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048577.068938:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08775f7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2968b expref: 8 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.068962:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c4151a800) 00010000:00010000:0.0:1789048577.068977:0:12131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789048577.069010:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08775f82 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.069027:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08775f82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.069039:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08775f82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789048577.069314:0:12131:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000070a055d1 reply state 0000000075c6a934 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08775f82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.069329:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08775f82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.069417:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c4151a100) 00010000:00010000:0.0:1789048577.069420:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789048577.069423:0:12131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789048577.069542:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789048577.078579:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:10501:x1875953097660928:12345-192.168.202.16@tcp:36:chmod.0 Request processed in 9731us (11936us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789048577.078614:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:1.0:1789048577.115139:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048577.115263:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097661056 00000100:00100000:2.0:1789048577.115275:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097661056 00000100:00100000:2.0:1789048577.115405:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:2.0:1789048577.115418:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:10502:x1875953097661056:12345-192.168.202.16@tcp:101:chown.0 00010000:00010000:2.0:1789048577.115596:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048577.115624:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837200/0x133f221c08775f89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29692 expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.115710:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08775f90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.115729:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08775f90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.115744:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08775f90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048577.115801:0:8649:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789048577.115805:0:8649:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789048577.115871:0:8649:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08775f90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.115903:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837200/0x133f221c08775f89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29692 expref: 11 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.115924:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08775f90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29692 expref: 10 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048577.115933:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c4151a100) 00010000:00010000:2.0:1789048577.115936:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789048577.115939:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02836600, rc 0) 00000100:00100000:2.0:1789048577.116022:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+10:10502:x1875953097661056:12345-192.168.202.16@tcp:101:chown.0 Request processed in 606us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048577.116031:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:3.0:1789048577.119760:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048577.119894:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097661184 00000100:00100000:0.0:1789048577.119908:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097661184 00000100:00100000:0.0:1789048577.119989:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:0.0:1789048577.120001:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0795bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+10:10502:x1875953097661184:12345-192.168.202.16@tcp:101:chown.0 00010000:00010000:0.0:1789048577.120030:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048577.120071:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08775f97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29699 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120162:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775f9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120181:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775f9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120196:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775f9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120207:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39400/0x133f221c08775fa5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120214:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39400/0x133f221c08775fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120222:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39400/0x133f221c08775fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120327:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08775fac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120671:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08775fac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120678:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08775fac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048577.120740:0:6499:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789048577.120744:0:6499:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789048577.120774:0:6499:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08775fac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120789:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775f9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120797:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775f9e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120805:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775f9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120812:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048577.120817:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775f9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120826:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775f9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120840:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c4151a100) 00010000:00010000:0.0:1789048577.120844:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048577.120850:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775f9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120867:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775f9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120883:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39400/0x133f221c08775fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120889:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39400/0x133f221c08775fa5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120896:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39400/0x133f221c08775fa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120901:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048577.120904:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39400/0x133f221c08775fa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120910:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39400/0x133f221c08775fa5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120918:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff959c05322c00) 00010000:00010000:0.0:1789048577.120920:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048577.120924:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39400/0x133f221c08775fa5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120930:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39400/0x133f221c08775fa5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120963:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08775f97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29699 expref: 12 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120979:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08775fac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29699 expref: 11 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.120993:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff959c05322400) 00010000:00010000:0.0:1789048577.120996:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789048577.120999:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38000, rc 0) 00000100:00100000:0.0:1789048577.121950:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0795bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+11:10502:x1875953097661184:12345-192.168.202.16@tcp:101:chown.0 Request processed in 1945us (2203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048577.121961:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:3.0:1789048577.125232:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048577.125448:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097661312 00000100:00100000:2.0:1789048577.125462:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097661312 00000100:00100000:2.0:1789048577.125528:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:2.0:1789048577.125540:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0795b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+11:10502:x1875953097661312:12345-192.168.202.16@tcp:900:chown.0 00000100:00100000:2.0:1789048577.125647:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0795b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+11:10502:x1875953097661312:12345-192.168.202.16@tcp:900:chown.0 Request processed in 109us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048577.125656:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:1.0:1789048577.129787:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048577.130066:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097661568 00000100:00100000:0.0:1789048577.130079:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097661568 00000100:00100000:0.0:1789048577.130156:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:0.0:1789048577.130168:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+11:10502:x1875953097661568:12345-192.168.202.16@tcp:36:chown.0 00010000:00010000:0.0:1789048577.130247:0:12131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048577.130283:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08775fac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29699 expref: 11 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.130305:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff959c05322400) 00010000:00010000:0.0:1789048577.130311:0:12131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789048577.130409:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08775fb3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.130583:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08775fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.130598:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08775fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789048577.133577:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:3.0:1789048577.133725:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08775f66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.133741:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08775f66 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.133751:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08775f66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.133758:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048577.133764:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08775f66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.133773:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08775f66 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.133794:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff959c05322c00) 00010000:00010000:3.0:1789048577.133798:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048577.133805:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08775f66 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.133813:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08775f66 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.133844:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08775f6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.133862:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08775f6d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.133868:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08775f6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.133874:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048577.133877:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08775f6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.133884:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08775f6d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.133894:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff959c05322400) 00010000:00010000:3.0:1789048577.133897:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048577.133900:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08775f6d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.133906:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08775f6d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.133921:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08775f82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.133927:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08775f82 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.133934:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08775f82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.133939:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048577.133948:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08775f82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.133955:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08775f82 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.133963:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c4151a100) 00010000:00010000:3.0:1789048577.133966:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789048577.133969:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08775f82 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.133976:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08775f82 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789048577.134793:0:12131:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000fd137211 reply state 00000000f16bc510 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08775fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.134832:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08775fb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.134841:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff959c05322400) 00010000:00010000:0.0:1789048577.134844:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789048577.134848:0:12131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789048577.134867:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1789048577.135029:0:12131:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789048577.135244:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:10502:x1875953097661568:12345-192.168.202.16@tcp:36:chown.0 Request processed in 5071us (5465us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789048577.135255:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 28 00010000:00010000:1.0:1789048577.135416:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08775fb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.135614:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08775fb3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.135622:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08775fb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.135629:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048577.135633:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08775fb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.135641:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08775fb3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.135658:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff959c05322400) 00010000:00010000:1.0:1789048577.135661:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789048577.135674:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08775fb3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.135681:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08775fb3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048577.149030:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048577.153023:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097661696 00000100:00100000:2.0:1789048577.153044:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097661696 00000100:00100000:2.0:1789048577.153155:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:2.0:1789048577.153168:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0795ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:10504:x1875953097661696:12345-192.168.202.16@tcp:101:touch.500 00010000:00010000:2.0:1789048577.153203:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048577.153251:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837200/0x133f221c08775fba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b296a0 expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789048577.160931:0:8649:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 7610us 00010000:00010000:0.0:1789048577.178951:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08775fc1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.178974:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08775fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.178986:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08775fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.179002:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775fc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.179008:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.179014:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.179151:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08775fcf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.179160:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08775fcf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.179166:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08775fcf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048577.179195:0:8649:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789048577.179199:0:8649:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789048577.179234:0:8649:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08775fcf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.179246:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08775fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.179252:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08775fc1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.179259:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08775fc1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.179265:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048577.179269:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08775fc1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.179276:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08775fc1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.179287:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c4151a100) 00010000:00010000:0.0:1789048577.179294:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048577.179300:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08775fc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.179306:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08775fc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.179319:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.179324:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775fc8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.180882:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.180901:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048577.180905:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.180914:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775fc8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.180927:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff959c4151a800) 00010000:00010000:0.0:1789048577.180931:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048577.180935:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775fc8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.180941:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775fc8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.180992:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837200/0x133f221c08775fba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296a0 expref: 8 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.181021:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08775fcf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296a0 expref: 7 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.181028:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff959c4151ad00) 00010000:00010000:0.0:1789048577.181031:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789048577.181033:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38800, rc 0) 00000100:00100000:0.0:1789048577.181112:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0795ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:10504:x1875953097661696:12345-192.168.202.16@tcp:101:touch.500 Request processed in 27946us (32095us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048577.181122:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:0.0:1789048577.186824:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048577.187004:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097661952 00000100:00100000:1.0:1789048577.187015:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097661952 00000100:00100000:1.0:1789048577.187077:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:1.0:1789048577.187088:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:10504:x1875953097661952:12345-192.168.202.16@tcp:101:touch.500 00010000:00010000:1.0:1789048577.187108:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048577.187129:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08775fd6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b296a7 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.187241:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08775fdd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.187256:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08775fdd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.187269:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08775fdd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.187284:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08775fe4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.187292:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08775fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.187300:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08775fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789048577.188007:0:6499:0:(osp_object.c:1667:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1789048577.188150:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c08775feb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.188160:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c08775feb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.188169:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c08775feb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.188198:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08775fdd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.188205:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08775fdd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.188212:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08775fdd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.188218:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048577.188222:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08775fdd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.188229:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08775fdd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.188239:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff959c4151ad00) 00010000:00010000:1.0:1789048577.188242:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048577.188247:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08775fdd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.188262:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08775fdd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789048577.188273:0:6499:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000afdf76cb reply state 000000006cf74aa1 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08775fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.188283:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08775fe4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.188289:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff959c3ef4af00) 00010000:00010000:1.0:1789048577.188292:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789048577.188295:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789048577.188323:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08775fd6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296a7 expref: 10 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.188766:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c08775feb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296a7 expref: 9 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.188775:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff959c3ef4a400) 00010000:00010000:1.0:1789048577.188777:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789048577.188780:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0200, rc 0) 00000100:00100000:1.0:1789048577.188845:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+10:10504:x1875953097661952:12345-192.168.202.16@tcp:101:touch.500 Request processed in 1759us (2031us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789048577.188854:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:1.0:1789048577.200501:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048577.201058:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097662208 00000100:00100000:0.0:1789048577.201068:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097662208 00000100:00100000:0.0:1789048577.201130:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:0.0:1789048577.201141:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+10:10504:x1875953097662208:12345-192.168.202.16@tcp:36:touch.500 00010000:00010000:0.0:1789048577.201200:0:12131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048577.201225:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c08775feb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296a7 expref: 10 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.201243:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff959c3ef4a400) 00010000:00010000:0.0:1789048577.201254:0:12131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789048577.201307:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775ff9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.201318:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.201327:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789048577.201518:0:12131:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000d11ccbeb reply state 00000000861fa49f transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.201530:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775ff9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.201537:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff959c4151a800) 00010000:00010000:0.0:1789048577.201539:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789048577.201542:0:12131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789048577.201991:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+11:10504:x1875953097662208:12345-192.168.202.16@tcp:36:touch.500 Request processed in 851us (1499us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789048577.201999:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:3.0:1789048577.204190:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048577.204266:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097662336 00000100:00100000:0.0:1789048577.204279:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097662336 00000100:00100000:0.0:1789048577.204733:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:0.0:1789048577.204744:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+11:10504:x1875953097662336:12345-192.168.202.16@tcp:101:touch.500 00010000:00010000:0.0:1789048577.204768:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048577.204788:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776000 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b296ae expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.204842:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776000 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296ae expref: 12 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.204855:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776000 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296ae expref: 12 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.204871:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff959c4151a800) 00010000:00010000:0.0:1789048577.204884:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789048577.204889:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38000, rc 0) 00000100:00100000:0.0:1789048577.204950:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+12:10504:x1875953097662336:12345-192.168.202.16@tcp:101:touch.500 Request processed in 209us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048577.204957:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:3.0:1789048577.213019:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048577.213136:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097662464 00000100:00100000:2.0:1789048577.213146:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097662464 00000100:00100000:2.0:1789048577.213218:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:2.0:1789048577.213226:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07958a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1875953097662464:12345-192.168.202.16@tcp:8:touch.500 00010000:00080000:2.0:1789048577.213259:0:8412:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp t0 exp 0000000000000000 cur 331 last 0 00000020:00000080:2.0:1789048577.213287:0:8412:0:(genops.c:1384:class_connect()) connect: client 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b, cookie 0x133f221c08776007 00002000:00100000:2.0:1789048577.213299:0:8412:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b/ffff959c3fb47000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789048577.213316:0:8412:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789048577.213442:0:8412:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789048577.213476:0:8412:0:(import.c:65:import_set_state_nolock()) ffff959c3fb47800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789048577.213529:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07958a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2390:x1875953097662464:12345-192.168.202.16@tcp:8:touch.500 Request processed in 303us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048577.213536:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:1.0:1789048577.233736:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048577.233900:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097662592 00000100:00100000:2.0:1789048577.233910:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097662592 00000100:00100000:2.0:1789048577.234026:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:2.0:1789048577.234034:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:0:x1875953097662592:12345-192.168.202.16@tcp:2:touch.500 00000100:00080000:0.0:1789048577.239174:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789048577.239735:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:1.0:1789048577.239745:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 00000100:00100000:2.0:1789048577.242790:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:0:x1875953097662592:12345-192.168.202.16@tcp:2:touch.500 Request processed in 8745us (9051us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789048577.243358:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:0.0:1789048577.246892:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048577.247104:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097662848 00000100:00100000:2.0:1789048577.247114:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097662848 00000100:00100000:2.0:1789048577.247169:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:2.0:1789048577.247191:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+12:10504:x1875953097662848:12345-192.168.202.16@tcp:35:touch.500 00000100:00100000:2.0:1789048577.247518:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+13:10504:x1875953097662848:12345-192.168.202.16@tcp:35:touch.500 Request processed in 327us (633us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789048577.247525:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:3.0:1789048577.260082:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048577.260239:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097662976 00000100:00100000:1.0:1789048577.260250:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097662976 00000100:00100000:1.0:1789048577.260313:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:1.0:1789048577.260324:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0795b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+13:10505:x1875953097662976:12345-192.168.202.16@tcp:101:rm.0 00010000:00010000:1.0:1789048577.260419:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048577.260443:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c0877600e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b296b5 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.260519:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776015 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.260533:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776015 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.260562:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776015 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048577.260865:0:6499:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789048577.260869:0:6499:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789048577.260907:0:6499:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776015 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.260935:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c0877600e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296b5 expref: 15 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.260953:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776015 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296b5 expref: 14 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.260962:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff959c4151ad00) 00010000:00010000:1.0:1789048577.260964:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789048577.260982:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0e00, rc 0) 00000100:00100000:1.0:1789048577.261081:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0795b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:10505:x1875953097662976:12345-192.168.202.16@tcp:101:rm.0 Request processed in 758us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048577.261088:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:1.0:1789048577.264956:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048577.265061:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097663232 00000100:00100000:0.0:1789048577.265071:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097663232 00000100:00100000:0.0:1789048577.265185:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:0.0:1789048577.265196:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:10505:x1875953097663232:12345-192.168.202.16@tcp:101:rm.0 00010000:00010000:0.0:1789048577.265217:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048577.265239:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39400/0x133f221c0877601c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b296bc expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048577.265391:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789048577.265723:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39400/0x133f221c0877601c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296bc expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.265739:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c4151a100) 00010000:00010000:0.0:1789048577.265743:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789048577.265748:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39400/0x133f221c0877601c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296bc expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.265763:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39400, rc 0) 00000100:00100000:0.0:1789048577.265985:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+15:10505:x1875953097663232:12345-192.168.202.16@tcp:101:rm.0 Request processed in 790us (1034us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1789048577.265994:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:1.0:1789048577.271201:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048577.271316:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097663360 00000100:00100000:2.0:1789048577.271372:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097663360 00000100:00100000:2.0:1789048577.271482:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:2.0:1789048577.271495:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+15:10505:x1875953097663360:12345-192.168.202.16@tcp:37:rm.0 00000100:00100000:2.0:1789048577.278804:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+15:10505:x1875953097663360:12345-192.168.202.16@tcp:37:rm.0 Request processed in 7293us (7592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048577.278823:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:1.0:1789048577.283931:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048577.284158:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097663616 00000100:00100000:0.0:1789048577.284172:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097663616 00000100:00100000:0.0:1789048577.284617:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:0.0:1789048577.284632:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2ad3ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+15:10505:x1875953097663616:12345-192.168.202.16@tcp:35:rm.0 00000100:00100000:0.0:1789048577.285008:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2ad3ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:10505:x1875953097663616:12345-192.168.202.16@tcp:35:rm.0 Request processed in 379us (1092us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789048577.285017:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:3.0:1789048577.288814:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048577.289119:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097663872 00000100:00100000:1.0:1789048577.289133:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097663872 00000100:00100000:1.0:1789048577.289481:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:1.0:1789048577.289496:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:10505:x1875953097663872:12345-192.168.202.16@tcp:101:rm.0 00010000:00010000:1.0:1789048577.289530:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048577.289558:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c0877602a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b296c3 expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.289693:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1600/0x133f221c08776031 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.289949:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1600/0x133f221c08776031 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.289965:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1600/0x133f221c08776031 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048577.289981:0:8649:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789048577.290193:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c0877602a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296c3 expref: 19 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.290290:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1600/0x133f221c08776031 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296c3 expref: 18 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.290323:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff959c4151ad00) 00010000:00010000:1.0:1789048577.290327:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789048577.290552:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1600, rc 0) 00000100:00100000:1.0:1789048577.290636:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+18:10505:x1875953097663872:12345-192.168.202.16@tcp:101:rm.0 Request processed in 1143us (1835us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789048577.290646:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:3.0:1789048577.294262:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048577.294432:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097664000 00000100:00100000:1.0:1789048577.294446:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097664000 00000100:00100000:1.0:1789048577.294525:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:1.0:1789048577.294537:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+18:10505:x1875953097664000:12345-192.168.202.16@tcp:41:rm.0 00000004:00000024:1.0:1789048577.294613:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1789048577.294732:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+18:10505:x1875953097664000:12345-192.168.202.16@tcp:41:rm.0 Request processed in 197us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048577.294739:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:0.0:1789048577.298104:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048577.298192:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097664128 00000100:00100000:1.0:1789048577.298213:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097664128 00000100:00100000:1.0:1789048577.298292:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:1.0:1789048577.298305:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+18:10505:x1875953097664128:12345-192.168.202.16@tcp:101:rm.0 00010000:00010000:1.0:1789048577.298360:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048577.298400:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877603f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b296ca expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.298485:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776046 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.298503:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776046 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.298533:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776046 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.298548:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877604d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.298556:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877604d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.298563:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877604d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.298680:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1a00/0x133f221c08776054 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.298978:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1a00/0x133f221c08776054 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.298988:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1a00/0x133f221c08776054 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048577.299037:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789048577.299042:0:6498:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789048577.299065:0:6498:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1a00/0x133f221c08776054 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.299078:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1a00/0x133f221c08776054 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.299087:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776046 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.299106:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776046 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.299114:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776046 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.299120:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048577.299125:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776046 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.299133:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776046 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.299148:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff959c4151ad00) 00010000:00010000:1.0:1789048577.299152:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048577.299158:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776046 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.299165:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776046 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.299182:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877604d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.299188:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877604d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.299194:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877604d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.299199:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048577.299209:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877604d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.299216:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877604d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.299225:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff959c3ef4af00) 00010000:00010000:1.0:1789048577.299227:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048577.299231:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877604d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.299237:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877604d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.299271:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877603f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296ca expref: 20 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.299287:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1a00/0x133f221c08776054 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296ca expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048577.299294:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff959c4151a800) 00010000:00010000:1.0:1789048577.299297:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789048577.299300:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1a00, rc 0) 00000100:00100000:1.0:1789048577.299443:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+19:10505:x1875953097664128:12345-192.168.202.16@tcp:101:rm.0 Request processed in 1139us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048577.299452:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:1.0:1789048577.306068:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048577.306151:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097664384 00000100:00100000:0.0:1789048577.306167:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097664384 00000100:00100000:0.0:1789048577.306247:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:0.0:1789048577.306260:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+19:10505:x1875953097664384:12345-192.168.202.16@tcp:36:rm.0 00010000:00010000:0.0:1789048577.306357:0:8649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789048577.306401:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1a00/0x133f221c08776054 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296ca expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.306429:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776000 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296ae expref: 18 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.306447:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff959c4151a800) 00010000:00010000:0.0:1789048577.306458:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776015 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296b5 expref: 17 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.306469:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff959c4151ad00) 00010000:00010000:0.0:1789048577.306472:0:8649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789048577.306502:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877605b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.306542:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877605b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.306554:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877605b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.306570:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776062 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.306578:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776062 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.306584:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776062 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.306721:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776069 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.306730:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776069 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.306737:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776069 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789048577.307210:0:8649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789048577.307224:0:8649:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332060890038ns, next at 333060885957ns, rc = 0 00010000:00010000:0.0:1789048577.307287:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776070 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.307298:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776070 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.307321:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776070 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.307330:0:8649:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776070 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.307385:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776070 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.307392:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776070 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.307555:0:8649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789048577.307582:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776069 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.307588:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776069 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.307595:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776069 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.307601:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048577.307606:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776069 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.307614:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776069 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.307626:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff959c4151a800) 00010000:00010000:0.0:1789048577.307629:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789048577.307642:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776069 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.307648:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776069 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.307667:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877605b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.307674:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877605b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.307680:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877605b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.307686:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048577.307689:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877605b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.307696:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877605b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.307705:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff959c4151ad00) 00010000:00010000:0.0:1789048577.307708:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048577.307711:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877605b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.307716:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877605b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789048577.307726:0:8649:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000076857de3 reply state 00000000650734b8 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776062 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.307751:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776062 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048577.307758:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff959c3ef4af00) 00010000:00010000:0.0:1789048577.307761:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789048577.307764:0:8649:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789048577.307869:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+18:10505:x1875953097664384:12345-192.168.202.16@tcp:36:rm.0 Request processed in 1608us (1812us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789048577.307878:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 38 00010000:00010000:3.0:1789048577.310600:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048577.310621:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776070 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.310635:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38a00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048577.310639:0:7447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776070 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.310651:0:7447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776070 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.310675:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff959c4151a800) 00010000:00010000:3.0:1789048577.310713:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789048577.310720:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776070 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.310727:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776070 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048577.311694:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048577.311807:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097664640 00000100:00100000:3.0:1789048577.311821:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097664640 00000100:00100000:3.0:1789048577.311891:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:3.0:1789048577.311901:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+18:10505:x1875953097664640:12345-192.168.202.16@tcp:35:rm.0 00000100:00100000:3.0:1789048577.312203:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+19:10505:x1875953097664640:12345-192.168.202.16@tcp:35:rm.0 Request processed in 302us (519us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789048577.312212:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00010000:00010000:2.0:1789048577.312835:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048577.312841:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048577.312843:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048577.314632:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048577.314781:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097664896 00000100:00100000:3.0:1789048577.314794:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097664896 00000100:00100000:3.0:1789048577.314867:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:3.0:1789048577.314879:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+19:10505:x1875953097664896:12345-192.168.202.16@tcp:36:rm.0 00010000:00010000:3.0:1789048577.314950:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789048577.314984:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1600/0x133f221c08776031 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296c3 expref: 19 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.315011:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08775fcf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296a0 expref: 18 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.315025:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff959c4151ad00) 00010000:00010000:3.0:1789048577.315060:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08775f90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29692 expref: 17 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.315098:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c4151a100) 00010000:00010000:3.0:1789048577.315105:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789048577.315139:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776077 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.315154:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776077 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.315167:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776077 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.315178:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3cc00/0x133f221c0877607e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.315183:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3cc00/0x133f221c0877607e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.315187:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3cc00/0x133f221c0877607e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.315293:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c200/0x133f221c08776085 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.315298:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c200/0x133f221c08776085 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.315303:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c200/0x133f221c08776085 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048577.315850:0:6497:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789048577.315871:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c200/0x133f221c08776085 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.315888:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c200/0x133f221c08776085 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.315896:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c200/0x133f221c08776085 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.315903:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048577.315909:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c200/0x133f221c08776085 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.315919:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c200/0x133f221c08776085 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.315929:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff959c09e4f900) 00010000:00010000:3.0:1789048577.315933:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789048577.315937:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c200/0x133f221c08776085 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.315943:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c200/0x133f221c08776085 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.315967:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776077 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.315974:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776077 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.315981:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776077 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.315987:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048577.315996:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776077 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.316004:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776077 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.316013:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c09e4f500) 00010000:00010000:3.0:1789048577.316016:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048577.316020:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776077 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.316027:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776077 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789048577.316040:0:6497:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000fb3f40fd reply state 0000000025781f35 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3cc00/0x133f221c0877607e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.316053:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3cc00/0x133f221c0877607e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048577.316059:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff959c09e4f600) 00010000:00010000:3.0:1789048577.316062:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789048577.316064:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789048577.316146:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+18:10505:x1875953097664896:12345-192.168.202.16@tcp:36:rm.0 Request processed in 1269us (1527us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789048577.316152:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:2.0:1789048577.502136:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111380224:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789048577.502203:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048577.502283:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111380224 00000100:00100000:2.0:1789048577.502291:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111380224 00000100:00100000:2.0:1789048577.502364:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789048577.502386:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111380224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789048577.502419:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789048577.502461:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111380224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048577.502467:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:2.0:1789048577.502506:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08108000 x1875953111380224/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048593 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048577.502544:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111380224:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789048577.502698:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789048577.502890:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111380352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789048577.502975:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048577.504070:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111380480:0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.504134:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048577.504170:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111380992:0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.504193:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048577.504221:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111381504:0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.504242:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048577.504263:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789048577.504267:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111380608:0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.504305:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048577.504322:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111381120:0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.504383:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048577.504399:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111381632:0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.504419:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048577.504448:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111380480 00000100:00100000:3.0:1789048577.504456:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111380480 00000100:00100000:3.0:1789048577.504499:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1789048577.504508:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111380480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.504552:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111380480:12345-0@lo:400:kworker.0 Request processed in 46us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048577.504559:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1789048577.504591:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111380992 00000100:00100000:3.0:1789048577.504595:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111380992 00000100:00100000:3.0:1789048577.504619:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789048577.504625:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111380992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.504658:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111380992:12345-0@lo:400:kworker.0 Request processed in 33us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048577.504664:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789048577.504681:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111381504 00000100:00100000:3.0:1789048577.504685:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111381504 00000100:00100000:3.0:1789048577.504718:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789048577.504725:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111381504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.504763:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111381504:12345-0@lo:400:kworker.0 Request processed in 39us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048577.504769:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789048577.504806:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111380480:0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.504818:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111380992:0@lo:400:kworker.0 00010000:00080000:3.0:1789048577.504828:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c2b610e00 x1875953111381504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048577.504839:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111381504:0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.504869:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111380608 00000100:00100000:3.0:1789048577.504873:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111380608 00000100:00100000:3.0:1789048577.504894:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111381120 00000100:00100000:3.0:1789048577.504896:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111381120 00000100:00100000:3.0:1789048577.504920:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111381632 00000100:00100000:3.0:1789048577.504923:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111381632 00000100:00100000:3.0:1789048577.504942:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789048577.504949:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111380608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.504984:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111380608:12345-0@lo:400:kworker.0 Request processed in 36us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048577.504990:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789048577.505002:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789048577.505008:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111381120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.505035:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111381120:12345-0@lo:400:kworker.0 Request processed in 28us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048577.505041:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789048577.505051:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789048577.505064:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111381632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.505092:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111381632:12345-0@lo:400:kworker.0 Request processed in 29us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048577.505097:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789048577.505120:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111380608:0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.505129:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111381120:0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.505136:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111381632:0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.505176:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111380736:0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.505203:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048577.505223:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111381248:0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.505244:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048577.505260:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111381760:0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.505279:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048577.505297:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789048577.505303:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111380864:0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.505324:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048577.505365:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111381376:0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.505400:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048577.505426:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111380736 00000100:00100000:3.0:1789048577.505430:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111380736 00000100:00100000:3.0:1789048577.505455:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789048577.505461:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111380736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.505496:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111380736:12345-0@lo:400:kworker.0 Request processed in 35us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048577.505512:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789048577.505532:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111381376 00000100:00100000:3.0:1789048577.505536:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111381376 00000100:00100000:3.0:1789048577.505560:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789048577.505566:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111381376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.505598:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111381376:12345-0@lo:400:kworker.0 Request processed in 32us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048577.505603:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:3.0:1789048577.505630:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d89500 x1875953111381376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048577.505640:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111381376:0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.505649:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111380736:0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.505664:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111381248 00000100:00100000:3.0:1789048577.505668:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111381248 00000100:00100000:3.0:1789048577.505684:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111381760 00000100:00100000:3.0:1789048577.505687:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111381760 00000100:00100000:3.0:1789048577.505696:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111380864 00000100:00100000:3.0:1789048577.505699:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111380864 00000100:00100000:3.0:1789048577.505710:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789048577.505715:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111381248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.505748:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111381248:12345-0@lo:400:kworker.0 Request processed in 32us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048577.505753:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789048577.505766:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789048577.505772:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111381760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.505810:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111381760:12345-0@lo:400:kworker.0 Request processed in 38us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048577.505816:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789048577.505829:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789048577.505835:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111380864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048577.505860:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111380864:12345-0@lo:400:kworker.0 Request processed in 26us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048577.505865:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789048577.505890:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111380864:0@lo:400:kworker.0 00010000:00080000:3.0:1789048577.505901:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0820c380 x1875953111381248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048577.505909:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111381248:0@lo:400:kworker.0 00010000:00080000:3.0:1789048577.505917:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080e5c00 x1875953111381760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048577.505924:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111381760:0@lo:400:kworker.0 00000100:00100000:0.0:1789048577.507006:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111380352 00000100:00100000:0.0:1789048577.507023:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111380352 00000100:00100000:0.0:1789048577.507129:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789048577.507140:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111380352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789048577.507171:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048577.507258:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111380352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (4283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048577.507266:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:0.0:1789048577.507312:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789048577.507318:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789048577.507321:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789048577.507324:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789048577.507770:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080d8700 x1875953111380352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048593 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048577.507797:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111380352:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789048578.013831:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048578.014502:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111381888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789048578.014570:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048578.014662:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111381888 00000100:00100000:3.0:1789048578.014670:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111381888 00000100:00100000:3.0:1789048578.014724:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789048578.014738:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111381888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789048578.014798:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789048578.014848:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111381888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048578.014863:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789048578.021080:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111381888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789048578.526059:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111382016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789048578.526123:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048578.526206:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111382016 00000100:00100000:0.0:1789048578.526213:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111382016 00000100:00100000:0.0:1789048578.526269:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789048578.526278:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111382016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789048578.526304:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048578.526374:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111382016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048578.526380:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:0.0:1789048578.526421:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080d8700 x1875953111382016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048578.526438:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111382016:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1789048578.526550:0:8801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 333280215176ns, next at 334280212380ns, rc = 0 00000100:00100000:0.0:1789048578.526874:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0822a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111382144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789048578.526904:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048578.526973:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111382144 00000100:00100000:1.0:1789048578.526979:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111382144 00000100:00100000:1.0:1789048578.527017:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789048578.527025:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111382144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789048578.527037:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048578.527071:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111382144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048578.527077:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:0.0:1789048578.527218:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0822a680 x1875953111382144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048578.527232:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0822a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111382144:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789048579.041927:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048579.549600:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789048579.549623:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111382272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048579.549694:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048579.549763:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111382272 00000100:00100000:3.0:1789048579.549771:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111382272 00000100:00100000:3.0:1789048579.549814:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789048579.549823:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111382272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789048579.549856:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789048579.549902:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111382272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048579.549909:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789048579.549957:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111382272:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789048580.061784:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048581.088034:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048581.210773:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048581.210833:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048581.210868:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048581.210921:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048581.210958:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048581.210986:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048581.211149:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097665280 00000100:00100000:0.0:1789048581.211164:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097665280 00000100:00100000:0.0:1789048581.211242:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097665536 00000100:00100000:0.0:1789048581.211246:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097665536 00000100:00100000:0.0:1789048581.211260:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097665152 00000100:00100000:0.0:1789048581.211262:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097665152 00000100:00100000:0.0:1789048581.211300:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097665664 00000100:00100000:1.0:1789048581.212061:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097665024 00000100:00100000:1.0:1789048581.212068:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097665024 00000100:00100000:1.0:1789048581.212119:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 343 00000100:00100000:1.0:1789048581.212129:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2393:x1875953097665024:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048581.212226:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2393:x1875953097665024:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 98us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048581.212235:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 343 00000100:00100000:1.0:1789048581.212281:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 231 00000100:00100000:1.0:1789048581.212290:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097665280:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048581.212656:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097665664 00000100:00100000:0.0:1789048581.212696:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 232 00000100:00100000:0.0:1789048581.212705:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097665536:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048581.212741:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097665536:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 36us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048581.212748:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 232 00000100:00100000:0.0:1789048581.212764:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 233 00000100:00100000:0.0:1789048581.212771:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+18:2393:x1875953097665152:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048581.212800:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+18:2393:x1875953097665152:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 29us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048581.212806:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 233 00000100:00100000:0.0:1789048581.212818:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 234 00000100:00100000:0.0:1789048581.212824:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097665664:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048581.212846:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097665664:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 22us (1859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048581.212852:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 234 00000100:00080000:0.0:1789048581.212871:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789048581.212876:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789048581.213003:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097665280:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 96us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048581.213033:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 231 00000100:00100000:3.0:1789048581.214149:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097665408 00000100:00100000:3.0:1789048581.214164:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097665408 00000100:00100000:3.0:1789048581.214251:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00100000:3.0:1789048581.214264:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097665408:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048581.214405:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097665408:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 144us (3444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048581.214413:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00080000:0.0:1789048581.214560:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789048582.111954:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048582.621678:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789048582.621702:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111382400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789048582.621773:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048582.621835:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111382400 00000100:00100000:0.0:1789048582.621844:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111382400 00000100:00100000:0.0:1789048582.621904:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789048582.621914:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111382400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789048582.621941:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048582.621982:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111382400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048582.621989:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1789048582.622011:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789048582.623704:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d74a80 x1875953111382400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048598 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048582.623732:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111382400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789048582.623818:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111382528:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048582.623868:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048582.623920:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111382528 00000100:00100000:0.0:1789048582.623926:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111382528 00000100:00100000:0.0:1789048582.623967:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789048582.623976:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111382528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789048582.623993:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048582.624029:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111382528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048582.624057:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:0.0:1789048582.624090:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d74a80 x1875953111382528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048598 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048582.624103:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111382528:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789048582.624117:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789048582.625712:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111382656:0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.625764:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048582.625799:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0822a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111383168:0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.625825:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048582.625844:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111383680:0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.625865:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048582.625887:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789048582.625893:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0822b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111383040:0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.625917:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048582.625936:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111383552:0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.625970:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048582.625998:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111382912:0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.626020:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048582.626036:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111383424:0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.626052:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048582.626066:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111383936:0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.626085:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048582.626101:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789048582.626106:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0822aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111382784:0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.626126:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048582.626142:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875953111383296:0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.626160:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048582.626183:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111383808:0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.626201:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048582.626221:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111382656 00000100:00100000:1.0:1789048582.626228:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111382656 00000100:00100000:1.0:1789048582.626267:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1789048582.626275:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3621:x1875953111382656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.626317:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3621:x1875953111382656:12345-0@lo:400:kworker.0 Request processed in 43us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048582.626355:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1789048582.626388:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111383168 00000100:00100000:1.0:1789048582.626392:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111383168 00000100:00100000:1.0:1789048582.626427:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111382912 00000100:00100000:1.0:1789048582.626431:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111382912 00000100:00100000:1.0:1789048582.626446:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789048582.626451:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111383168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.626484:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111383168:12345-0@lo:400:kworker.0 Request processed in 33us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048582.626490:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789048582.626501:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789048582.626507:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111382912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.626535:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111382912:12345-0@lo:400:kworker.0 Request processed in 28us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048582.626540:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789048582.626557:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111383680 00000100:00100000:1.0:1789048582.626561:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111383680 00000100:00100000:1.0:1789048582.626595:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111383552 00000100:00100000:1.0:1789048582.626598:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111383552 00000100:00100000:1.0:1789048582.626616:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789048582.626631:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111383680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.626662:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111383680:12345-0@lo:400:kworker.0 Request processed in 32us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048582.626668:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789048582.626679:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789048582.626685:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111383552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.626710:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111383552:12345-0@lo:400:kworker.0 Request processed in 26us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048582.626716:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789048582.626734:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111383040 00000100:00100000:1.0:1789048582.626738:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111383040 00000100:00100000:1.0:1789048582.626754:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111383424 00000100:00100000:1.0:1789048582.626756:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111383424 00000100:00100000:1.0:1789048582.626767:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111383936 00000100:00100000:1.0:1789048582.626769:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111383936 00000100:00100000:1.0:1789048582.626782:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111382784 00000100:00100000:1.0:1789048582.626784:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111382784 00000100:00100000:1.0:1789048582.626793:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111383296 00000100:00100000:1.0:1789048582.626795:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111383296 00000100:00100000:1.0:1789048582.626805:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111383808 00000100:00100000:1.0:1789048582.626807:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111383808 00000100:00100000:1.0:1789048582.626822:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789048582.626828:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111383040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.626857:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111383040:12345-0@lo:400:kworker.0 Request processed in 29us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048582.626863:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789048582.626874:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789048582.626879:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111383424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.626913:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111383424:12345-0@lo:400:kworker.0 Request processed in 34us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048582.626919:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789048582.626930:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789048582.626935:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111383936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.626960:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111383936:12345-0@lo:400:kworker.0 Request processed in 25us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048582.626965:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789048582.626975:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789048582.626980:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111382784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.627020:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111382784:12345-0@lo:400:kworker.0 Request processed in 40us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048582.627026:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789048582.627037:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789048582.627042:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875953111383296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.627062:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875953111383296:12345-0@lo:400:kworker.0 Request processed in 21us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048582.627067:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789048582.627075:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789048582.627080:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111383808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.627100:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111383808:12345-0@lo:400:kworker.0 Request processed in 20us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048582.627104:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789048582.627173:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0822aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111382784:0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.627194:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875953111383296:0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.627203:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111383808:0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.627212:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111382912:0@lo:400:kworker.0 00010000:00080000:1.0:1789048582.627222:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07bf1880 x1875953111383424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048582.627232:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111383424:0@lo:400:kworker.0 00010000:00080000:1.0:1789048582.627240:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07bf0e00 x1875953111383936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048582.627248:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111383936:0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.627283:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0822b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111383040:0@lo:400:kworker.0 00010000:00080000:1.0:1789048582.627293:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07bf2680 x1875953111383552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048582.627300:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111383552:0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.627308:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111382656:0@lo:400:kworker.0 00000100:00100000:1.0:1789048582.627317:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0822a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111383168:0@lo:400:kworker.0 00010000:00080000:1.0:1789048582.627361:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07bf0700 x1875953111383680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048582.627369:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111383680:0@lo:400:kworker.0 00000100:00080000:0.0:1789048582.628720:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789048582.628739:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789048582.628742:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1789048582.715492:0:13663:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1789048583.133726:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789048583.133748:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111384064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789048583.133821:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048583.134143:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111384064 00000100:00100000:3.0:1789048583.134151:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111384064 00000100:00100000:3.0:1789048583.134201:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789048583.134231:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111384064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789048583.134265:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789048583.134682:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111384064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 460us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048583.134690:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00010000:2.0:1789048583.134845:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048583.135092:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111384064:0@lo:41:osp-pre-0-1.0 00000004:00080000:2.0:1789048583.137769:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1789048583.137816:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1789048583.137828:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1789048583.138139:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08775fe4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138168:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08775fe4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138175:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08775fe4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138180:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048583.138185:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08775fe4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138193:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08775fe4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138209:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff959c3ef4af00) 00010000:00010000:1.0:1789048583.138212:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048583.138217:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08775fe4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138224:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08775fe4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138244:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775ff9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138250:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775ff9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138255:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775ff9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138260:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048583.138269:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775ff9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138276:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775ff9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138285:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff959c4151a800) 00010000:00010000:1.0:1789048583.138288:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048583.138291:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775ff9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138297:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08775ff9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138326:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776062 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138379:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776062 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138387:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776062 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138391:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048583.138394:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776062 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138401:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776062 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138409:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff959c3ef4af00) 00010000:00010000:1.0:1789048583.138412:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048583.138421:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776062 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138428:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776062 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138444:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3cc00/0x133f221c0877607e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138450:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3cc00/0x133f221c0877607e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138455:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3cc00/0x133f221c0877607e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138460:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3cc00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048583.138463:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3cc00/0x133f221c0877607e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138469:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3cc00/0x133f221c0877607e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138477:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff959c09e4f600) 00010000:00010000:1.0:1789048583.138480:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048583.138483:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3cc00/0x133f221c0877607e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.138489:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3cc00/0x133f221c0877607e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048583.138525:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789048583.138543:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111384192:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789048583.138607:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048583.138918:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111384192 00000100:00100000:1.0:1789048583.138925:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111384192 00000100:00100000:1.0:1789048583.138975:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789048583.138991:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111384192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789048583.139015:0:8804:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1789048583.139045:0:8804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x18d3fa33e629e400, atime: 0x18d3fa33e629e400, ctime: 0x18d3fa33e629e400, blocks: 0x0 00010000:00010000:1.0:1789048583.139052:0:8804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c0877608c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.139065:0:8804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=337s v=(0 0) 00010000:00010000:1.0:1789048583.139069:0:8804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048583.139076:0:8804:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c0877608c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.139092:0:8804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c0877608c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.139100:0:8804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c0877608c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.139107:0:8804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c0877608c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048583.139133:0:8804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789048583.139672:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3620:x1875953111384192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 682us (1064us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789048583.139680:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1789048583.139817:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048583.139824:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c0877608c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048583.139833:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0a00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048583.139837:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c0877608c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048583.139844:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c0877608c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048583.139862:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c0877608c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048583.139869:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c0877608c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048583.139901:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048583.139903:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048583.139905:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789048583.140147:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff959b080e5180/2, rc 0, transno 4294967301 00000100:00100000:3.0:1789048583.140154:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111384192:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789048583.646772:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b082ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111384320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789048583.646845:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048583.646920:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111384320 00000100:00100000:1.0:1789048583.646927:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111384320 00000100:00100000:1.0:1789048583.646971:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789048583.646979:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875953111384320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789048583.647004:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048583.647043:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875953111384320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048583.647050:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789048583.647096:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b082ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111384320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789048583.652667:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789048583.652689:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111384448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048583.652755:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048583.652944:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111384448 00000100:00100000:0.0:1789048583.652952:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111384448 00000100:00100000:0.0:1789048583.653000:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789048583.653010:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111384448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789048583.653030:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048583.653073:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111384448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048583.653079:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789048583.653123:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111384448:0@lo:13:osp-pre-0-1.0 00000020:00000080:0.0:1789048584.082319:0:13711:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffecae93f90 20000000:00000080:0.0:1789048584.083761:0:13711:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff959c41551c00 uarg=0000000000000000 20000000:01000000:0.0:1789048584.083816:0:13711:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789048584.083823:0:13711:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789048584.083828:0:13711:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789048584.085472:0:13712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1789048584.086109:0:13711:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1789048584.091826:0:13711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1789048584.091867:0:13711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1789048584.091883:0:13711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1789048584.091899:0:13711:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789048584.091919:0:13711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff959c3ef3c200/0x133f221c08776093 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048584.091938:0:13711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2967d expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048584.091947:0:13711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c3ef3dc00/0x133f221c08775f20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29684 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048584.091955:0:13711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c3ef3ce00/0x133f221c08775f2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775f27 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048584.091964:0:13711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c3ef39600/0x133f221c08775f3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775f35 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048584.091972:0:13711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959b07ba1c00/0x133f221c08775f4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775f43 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048584.091979:0:13711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c02837e00/0x133f221c08775f58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08775f51 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048584.092000:0:13711:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959c3ef3c200/0x133f221c08776093 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048584.092040:0:13711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c02837e00/0x133f221c08775f58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775f51 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048584.092055:0:13711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c02837e00/0x133f221c08775f58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775f51 expref: 23 pid: 6490 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048584.092070:0:13711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1875953111384576:0@lo:104: 00000100:00100000:3.0:1789048584.092149:0:13711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789048584.092248:0:13711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959b07ba1c00/0x133f221c08775f4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775f43 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048584.092256:0:13711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959b07ba1c00/0x133f221c08775f4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775f43 expref: 23 pid: 6492 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048584.092265:0:13711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1875953111384704:0@lo:104: 00010000:00010000:3.0:1789048584.092290:0:13711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c3ef39600/0x133f221c08775f3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775f35 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048584.092298:0:13711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c3ef39600/0x133f221c08775f3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775f35 expref: 23 pid: 6491 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048584.092316:0:13711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1875953111384832:0@lo:104: 00010000:00010000:3.0:1789048584.092379:0:13711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c3ef3ce00/0x133f221c08775f2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08775f27 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048584.092386:0:13711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff959c3ef3ce00/0x133f221c08775f2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08775f27 expref: 23 pid: 6492 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048584.092403:0:13711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1875953111384960:0@lo:104: 00010000:00010000:3.0:1789048584.092432:0:13711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c3ef3dc00/0x133f221c08775f20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29684 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048584.092443:0:13711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c3ef3dc00/0x133f221c08775f20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29684 expref: 12 pid: 6492 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048584.092455:0:13711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1875953111385088:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048584.092519:0:13711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2967d expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048584.092527:0:13711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2967d expref: 12 pid: 6492 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048584.092535:0:13711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d89500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1875953111385216:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048584.092556:0:13711:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c42900 going to sleep for 11 seconds 00000100:00100000:3.0:1789048584.094283:0:6479:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789048584.094357:0:6479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048584.094395:0:6479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048584.094421:0:6479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048584.094432:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111384576 00000100:00100000:3.0:1789048584.094439:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111384576 00000100:00100000:3.0:1789048584.094480:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111384704 00000100:00100000:3.0:1789048584.094483:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111384704 00000100:00100000:3.0:1789048584.094493:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111384832 00000100:00100000:3.0:1789048584.094496:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111384832 00000100:00100000:3.0:1789048584.094503:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111384960 00000100:00100000:3.0:1789048584.094505:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111384960 00000100:00100000:3.0:1789048584.094535:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789048584.094545:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+6:13711:x1875953111384576:12345-0@lo:104: 00010000:00010000:3.0:1789048584.094560:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959b07ba1e00/0x133f221c08775f51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775f58 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048584.094620:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789048584.094627:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+6:13711:x1875953111384576:12345-0@lo:104: Request processed in 84us (2478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048584.094633:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789048584.094693:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789048584.094700:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b610700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+5:13711:x1875953111384704:12345-0@lo:104: 00010000:00010000:3.0:1789048584.094709:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08775f43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775f4a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048584.094742:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789048584.094747:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b610700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+5:13711:x1875953111384704:12345-0@lo:104: Request processed in 48us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048584.094752:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789048584.094764:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789048584.094771:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b610e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:13711:x1875953111384832:12345-0@lo:104: 00010000:00010000:3.0:1789048584.094778:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775f35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775f3c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048584.094807:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789048584.094812:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b610e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+4:13711:x1875953111384832:12345-0@lo:104: Request processed in 43us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048584.094818:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789048584.094830:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789048584.094845:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:13711:x1875953111384960:12345-0@lo:104: 00010000:00010000:3.0:1789048584.094853:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775f27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775f2e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048584.094881:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789048584.094886:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+3:13711:x1875953111384960:12345-0@lo:104: Request processed in 44us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048584.094892:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789048584.094934:0:13711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1875953111384576:0@lo:104: 00000100:00100000:3.0:1789048584.094944:0:13711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1875953111384704:0@lo:104: 00000100:00100000:3.0:1789048584.094950:0:13711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1875953111384832:0@lo:104: 00000100:00100000:3.0:1789048584.094957:0:13711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1875953111384960:0@lo:104: 00010000:00010000:2.0:1789048584.095233:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789048584.095241:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959b07ba1e00/0x133f221c08775f51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775f58 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.095248:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1e00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048584.095252:0:7447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959b07ba1e00/0x133f221c08775f51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775f58 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.095260:0:7447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959b07ba1e00/0x133f221c08775f51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775f58 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048584.095268:0:7447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959b07ba1e00/0x133f221c08775f51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775f58 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048584.095274:0:7447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789048584.095324:0:7447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959b07ba1e00/0x133f221c08775f51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775f58 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.095360:0:7447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048584.095389:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959b07ba1e00/0x133f221c08775f51 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775f58 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.095409:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959b07ba1e00/0x133f221c08775f51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775f58 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.095421:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789048584.095425:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08775f43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775f4a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.095430:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39e00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048584.095433:0:7447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08775f43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775f4a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.095441:0:7447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08775f43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775f4a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048584.095447:0:7447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08775f43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775f4a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048584.095452:0:7447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789048584.095467:0:7447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08775f43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775f4a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.095473:0:7447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048584.095479:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08775f43 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775f4a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.095486:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08775f43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775f4a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.095494:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789048584.095503:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775f35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775f3c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.095509:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837000 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048584.095512:0:7447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775f35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775f3c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.095518:0:7447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775f35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775f3c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048584.095524:0:7447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775f35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775f3c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048584.095528:0:7447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789048584.095542:0:7447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775f35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775f3c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.095548:0:7447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048584.095560:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775f35 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775f3c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.095566:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c02837000/0x133f221c08775f35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775f3c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.095576:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048584.095579:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775f27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08775f2e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.095585:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837600 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048584.095588:0:7447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775f27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08775f2e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.095604:0:7447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775f27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08775f2e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048584.095610:0:7447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775f27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08775f2e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048584.095615:0:7447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789048584.095627:0:7447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775f27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775f2e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.095633:0:7447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048584.095648:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775f27 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775f2e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.095654:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c02837600/0x133f221c08775f27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08775f2e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.095667:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048584.095669:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048584.095671:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048584.095677:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048584.095837:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111385728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789048584.095881:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048584.095929:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789048584.095934:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111385600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789048584.095954:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048584.095982:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111385728 00000100:00100000:1.0:1789048584.095989:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111385728 00010000:00010000:1.0:1789048584.096017:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c3ef3ce00/0x133f221c08775f2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775f27 expref: 24 pid: 6492 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048584.096038:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111385600 00000100:00100000:1.0:1789048584.096041:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111385600 00010000:00010000:1.0:1789048584.096051:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c3ef39600/0x133f221c08775f3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775f35 expref: 25 pid: 6491 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048584.096066:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789048584.096073:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+25:3623:x1875953111385728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789048584.096084:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048584.096096:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c3ef3ce00/0x133f221c08775f2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775f27 expref: 25 pid: 6492 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048584.096105:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c3ef3ce00/0x133f221c08775f2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775f27 expref: 25 pid: 6492 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048584.096119:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3ce00/0x133f221c08775f2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775f27 expref: 25 pid: 6492 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048584.096132:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048584.096159:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3623:x1875953111385728:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048584.096165:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789048584.096180:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789048584.096185:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:3623:x1875953111385600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789048584.096192:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048584.096196:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c3ef39600/0x133f221c08775f3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775f35 expref: 23 pid: 6491 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048584.096203:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c3ef39600/0x133f221c08775f3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775f35 expref: 23 pid: 6491 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048584.096212:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef39600/0x133f221c08775f3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775f35 expref: 23 pid: 6491 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048584.096220:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048584.096241:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:3623:x1875953111385600:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048584.096247:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789048584.096276:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111385600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789048584.096292:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111385728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048584.096382:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111385344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048584.096409:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048584.096436:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789048584.096441:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111385472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048584.096461:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048584.096585:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111385344 00000100:00100000:1.0:1789048584.096590:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111385344 00010000:00010000:1.0:1789048584.096606:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c02837e00/0x133f221c08775f58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775f51 expref: 22 pid: 6490 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048584.096618:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111385472 00000100:00100000:1.0:1789048584.096622:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111385472 00010000:00010000:1.0:1789048584.096632:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959b07ba1c00/0x133f221c08775f4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775f43 expref: 23 pid: 6492 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048584.096654:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789048584.096660:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:3620:x1875953111385344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789048584.096667:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048584.096671:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c02837e00/0x133f221c08775f58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775f51 expref: 23 pid: 6490 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048584.096681:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c02837e00/0x133f221c08775f58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775f51 expref: 23 pid: 6490 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048584.096691:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c02837e00/0x133f221c08775f58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775f51 expref: 23 pid: 6490 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048584.096700:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048584.096724:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:3620:x1875953111385344:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048584.096730:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789048584.096741:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789048584.096746:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:3620:x1875953111385472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789048584.096759:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048584.096764:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959b07ba1c00/0x133f221c08775f4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08775f43 expref: 21 pid: 6492 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048584.096773:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959b07ba1c00/0x133f221c08775f4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08775f43 expref: 21 pid: 6492 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048584.096782:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b07ba1c00/0x133f221c08775f4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08775f43 expref: 21 pid: 6492 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048584.096790:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048584.096810:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:3620:x1875953111385472:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048584.096815:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789048584.096933:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111385472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048584.096940:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111385344:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789048584.097460:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048584.105044:0:13711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1875953111385088:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048584.105060:0:13711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d89500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1875953111385216:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048584.105097:0:13711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff959c3ef3c200/0x133f221c08776093 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048584.114791:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048584.115142:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097665792 00000100:00100000:1.0:1789048584.115154:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097665792 00010000:00010000:1.0:1789048584.115206:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c3ef3dc00/0x133f221c08775f20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29684 expref: 13 pid: 6492 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048584.115252:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:1.0:1789048584.115263:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2393:x1875953097665792:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048584.115279:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048584.115285:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c3ef3dc00/0x133f221c08775f20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29684 expref: 13 pid: 6492 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048584.115298:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c3ef3dc00/0x133f221c08775f20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29684 expref: 13 pid: 6492 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048584.115328:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3dc00/0x133f221c08775f20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29684 expref: 13 pid: 6492 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048584.115404:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048584.115458:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:2393:x1875953097665792:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 197us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048584.115465:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:0.0:1789048584.119072:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048584.119218:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097665920 00000100:00100000:2.0:1789048584.119229:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097665920 00010000:00010000:2.0:1789048584.119277:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2967d expref: 12 pid: 6492 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048584.119329:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:2.0:1789048584.119377:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:2393:x1875953097665920:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048584.119410:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048584.119418:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2967d expref: 12 pid: 6492 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.119431:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2967d expref: 12 pid: 6492 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.119449:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3c600/0x133f221c08775f19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2967d expref: 12 pid: 6492 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.119466:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959c3ef3c200/0x133f221c08776093 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.119474:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3c200/0x133f221c08776093 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.119490:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef3c200/0x133f221c08776093 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.119497:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef3c200/0x133f221c08776093 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.119504:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff959c3ef3c200/0x133f221c08776093 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.119510:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff959c3ef3c200/0x133f221c08776093 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.119516:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048584.119520:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff959c3ef3c200/0x133f221c08776093 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.119539:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff959c3ef3c200/0x133f221c08776093 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.119552:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff959c3ef3c200/0x133f221c08776093 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.119562:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048584.119623:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+11:2393:x1875953097665920:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 249us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048584.119632:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 51 00010000:00010000:0.0:1789048584.119840:0:13711:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff959c3ef3c200/0x133f221c08776093 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048584.119851:0:13711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff959c3ef3c200/0x133f221c08776093 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048584.119887:0:13711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3c200/0x133f221c08776093 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048584.160553:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048584.671872:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789048584.671903:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111385856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048584.671982:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048584.674553:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111385856 00000100:00100000:2.0:1789048584.674571:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111385856 00000100:00100000:2.0:1789048584.674648:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789048584.674660:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111385856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789048584.674698:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789048584.674777:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111385856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (2794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048584.674784:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789048584.674931:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111385856:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789048585.182514:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048585.217486:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048585.217635:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097666048 00000100:00100000:2.0:1789048585.217658:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097666048 00000100:00100000:2.0:1789048585.217714:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 345 00000100:00100000:2.0:1789048585.217725:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+11:6169:x1875953097666048:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048585.217742:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048585.217762:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c02837600/0x133f221c0877609a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b296d1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048585.217805:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c02837600/0x133f221c0877609a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296d1 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048585.217816:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c02837600/0x133f221c0877609a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296d1 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048585.217826:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02837600, rc 0) 00000100:00100000:2.0:1789048585.217877:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:6169:x1875953097666048:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 154us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048585.217884:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 345 00000100:00100000:3.0:1789048585.229145:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048585.229254:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097666176 00000100:00100000:0.0:1789048585.229265:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097666176 00000100:00100000:0.0:1789048585.229372:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 346 00000100:00100000:0.0:1789048585.229382:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:6169:x1875953097666176:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048585.229535:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:6169:x1875953097666176:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 154us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048585.229542:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 346 00000100:00100000:0.0:1789048585.234959:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048585.236476:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097666304 00000100:00100000:3.0:1789048585.236492:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097666304 00000100:00100000:3.0:1789048585.236562:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 347 00000100:00100000:3.0:1789048585.236574:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:6169:x1875953097666304:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789048585.236950:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:6169:x1875953097666304:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 377us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048585.236959:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 347 00000020:00000080:0.0:1789048585.253734:0:13760:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe728e9870 20000000:00000080:0.0:1789048585.253752:0:13760:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff959c41552800 uarg=0000000000000000 20000000:01000000:0.0:1789048585.253792:0:13760:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1789048585.253798:0:13760:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1789048585.253803:0:13760:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1789048585.254602:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1789048585.254935:0:13760:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1789048585.255048:0:13760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1789048585.255084:0:13760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1789048585.255102:0:13760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1789048585.255117:0:13760:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789048585.255144:0:13760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff959c3ef3c400/0x133f221c087760a1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.255170:0:13760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c02837600/0x133f221c0877609a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296d1 expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.255178:0:13760:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959c3ef3c400/0x133f221c087760a1 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.255231:0:13760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c02837600/0x133f221c0877609a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b296d1 expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.255261:0:13760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c02837600/0x133f221c0877609a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b296d1 expref: 11 pid: 6491 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048585.255281:0:13760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13760:1875953111385984:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048585.255527:0:13760:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b069760c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048585.259918:0:13760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13760:1875953111385984:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048585.259957:0:13760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff959c3ef3c400/0x133f221c087760a1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048585.260037:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048585.260367:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097666432 00000100:00100000:3.0:1789048585.260377:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097666432 00000100:00100000:3.0:1789048585.260435:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 348 00000100:00100000:3.0:1789048585.260446:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:10789:x1875953097666432:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789048585.260621:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:10789:x1875953097666432:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 176us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048585.260630:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 348 00000100:00100000:0.0:1789048585.266607:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048585.267924:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097666560 00000100:00100000:3.0:1789048585.267943:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097666560 00000100:00100000:3.0:1789048585.268025:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 349 00000100:00100000:3.0:1789048585.268037:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:10789:x1875953097666560:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789048585.268212:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:10789:x1875953097666560:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 176us (1618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048585.268228:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 349 00000100:00100000:1.0:1789048585.273835:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048585.274070:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097666688 00000100:00100000:3.0:1789048585.274095:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097666688 00000100:00100000:3.0:1789048585.274156:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 350 00000100:00100000:3.0:1789048585.274167:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:6169:x1875953097666688:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048585.274184:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048585.274474:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef3c600/0x133f221c087760a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b296d8 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.274503:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c3ef3c400/0x133f221c087760a1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.274513:0:6491:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959c3ef3c600/0x133f221c087760a8 lrc: 4/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296d8 expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.274530:0:6491:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff959c3ef3c400/0x133f221c087760a1 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.274544:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef3c600/0x133f221c087760a8 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296d8 expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.274553:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3c600, rc 0) 00000100:00100000:3.0:1789048585.274617:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:6169:x1875953097666688:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 451us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048585.274625:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 350 00000100:00100000:1.0:1789048585.279915:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048585.280030:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097666816 00000100:00100000:2.0:1789048585.280040:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097666816 00010000:00010000:2.0:1789048585.280082:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c02837600/0x133f221c0877609a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b296d1 expref: 13 pid: 6491 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048585.280130:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:2.0:1789048585.280140:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2aece850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2391:x1875953097666816:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048585.280155:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048585.280161:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c02837600/0x133f221c0877609a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b296d1 expref: 13 pid: 6491 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048585.280173:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c02837600/0x133f221c0877609a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b296d1 expref: 13 pid: 6491 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048585.280191:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c02837600/0x133f221c0877609a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b296d1 expref: 13 pid: 6491 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048585.280226:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959c3ef3c400/0x133f221c087760a1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048585.280234:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3c400/0x133f221c087760a1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048585.280252:0:6482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef3c400/0x133f221c087760a1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048585.280259:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef3c400/0x133f221c087760a1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048585.280266:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff959c3ef3c400/0x133f221c087760a1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048585.280273:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff959c3ef3c400/0x133f221c087760a1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048585.280279:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c400 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048585.280283:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff959c3ef3c400/0x133f221c087760a1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048585.280290:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff959c3ef3c400/0x133f221c087760a1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048585.280320:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959c3ef3c600/0x133f221c087760a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296d8 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048585.280327:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3c600/0x133f221c087760a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296d8 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048585.280406:0:6482:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff959c3ef3c600/0x133f221c087760a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296d8 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048585.280420:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:MGS:6482:1875953111386112:192.168.202.16@tcp:105: 00000100:00100000:2.0:1789048585.280504:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88e40 going to sleep for 11 seconds 00010000:00010000:3.0:1789048585.284006:0:13760:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff959c3ef3c400/0x133f221c087760a1 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.284034:0:13760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff959c3ef3c400/0x133f221c087760a1 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048585.303145:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048585.303186:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097666944 00000100:00100000:0.0:1789048585.303197:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097666944 00000100:00100000:0.0:1789048585.303262:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 351 00000100:00100000:0.0:1789048585.303272:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:6169:x1875953097666944:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048585.312026:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:6169:x1875953097666944:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 8737us (8877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048585.312057:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 351 00000100:00100000:0.0:1789048585.312186:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:MGS:6482:1875953111386112:192.168.202.16@tcp:105: 00010000:00010000:0.0:1789048585.312219:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff959c3ef3c400/0x133f221c087760a1 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048585.312234:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3c400/0x133f221c087760a1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048585.312249:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048585.312276:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2aece850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:2391:x1875953097666816:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 32138us (32372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048585.312286:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:0.0:1789048585.322993:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048585.323262:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097667072 00000100:00100000:3.0:1789048585.323303:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097667072 00000100:00100000:2.0:1789048585.323880:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 352 00000100:00100000:2.0:1789048585.323909:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:6169:x1875953097667072:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048585.324120:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:6169:x1875953097667072:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 226us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048585.324128:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 352 00000100:00100000:3.0:1789048585.331785:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048585.331902:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097667200 00000100:00100000:0.0:1789048585.331965:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097667200 00000100:00100000:0.0:1789048585.332314:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 353 00000100:00100000:0.0:1789048585.332328:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:10793:x1875953097667200:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789048585.332577:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:10793:x1875953097667200:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 251us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048585.332585:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 353 00000100:00100000:1.0:1789048585.351939:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048585.352045:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097667328 00000100:00100000:2.0:1789048585.352054:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097667328 00000100:00100000:2.0:1789048585.352125:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 354 00000100:00100000:2.0:1789048585.352134:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:10793:x1875953097667328:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789048585.352276:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:10793:x1875953097667328:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 142us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048585.352284:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 354 10000000:01000000:1.0:1789048585.821612:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789048585.821690:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959b06952000 from 7 10000000:01000000:1.0:1789048585.821695:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789048585.821744:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba1a00/0x133f221c087760af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048585.821756:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b07ba1a00/0x133f221c087760af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048585.821768:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b07ba1a00/0x133f221c087760af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048585.821795:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b082eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111386240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789048585.821874:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048585.822009:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0793acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048585.822605:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111386240 00000100:00100000:0.0:1789048585.822615:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111386240 00000100:00100000:0.0:1789048585.822770:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1789048585.822780:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:6494:x1875953111386240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789048585.822794:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048585.822809:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef38400/0x133f221c087760b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087760af expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048585.822832:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef38400/0x133f221c087760b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087760af expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048585.822857:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef38400/0x133f221c087760b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087760af expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048585.822878:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38400, rc 0) 00000100:00100000:0.0:1789048585.822938:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111386240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048585.822945:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789048585.823022:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b082eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111386240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048585.823039:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b07ba1a00/0x133f221c087760af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087760b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048585.823050:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b07ba1a00/0x133f221c087760af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087760b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048585.823129:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111386368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048585.823170:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048585.825901:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88600 going to sleep for 11 seconds 00000100:00100000:1.0:1789048585.826256:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111386368 00000100:00100000:1.0:1789048585.826266:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111386368 00000100:00100000:1.0:1789048585.826759:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789048585.826770:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111386368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048585.827075:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111386368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 306us (3903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048585.827098:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789048585.827837:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111386368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048585.827970:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111386496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048585.828026:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048585.828105:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88600 going to sleep for 11 seconds 00000100:00100000:1.0:1789048585.828139:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111386496 00000100:00100000:1.0:1789048585.828213:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111386496 00000100:00100000:1.0:1789048585.828309:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789048585.828319:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111386496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048585.828857:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111386496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 539us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048585.828875:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1789048585.828967:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111386496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048585.829800:0:13773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:13773:1875953111386624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789048585.829847:0:13773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048585.832820:0:13773:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88180 going to sleep for 11 seconds 00000100:00100000:0.0:1789048585.832903:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111386624 00000100:00100000:0.0:1789048585.832913:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111386624 00000100:00100000:1.0:1789048585.833028:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789048585.833042:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:13773:x1875953111386624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048585.835860:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:13773:x1875953111386624:12345-0@lo:502:llog_process_th.0 Request processed in 2814us (6004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048585.835885:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1789048585.836007:0:13773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:13773:1875953111386624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789048585.836048:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789048585.836058:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048585.836060:0:13773:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789048585.836066:0:13773:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959b06952000 00000020:00000080:2.0:1789048585.836069:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789048585.836136:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789048585.836140:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048585.836141:0:13773:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789048585.836735:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789048585.836744:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048585.836746:0:13773:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789048585.836753:0:13773:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959b06952000 00000020:00000080:2.0:1789048585.836755:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789048585.836826:0:13773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:13773:1875953111386752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789048585.836909:0:13773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048585.843499:0:13773:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88180 going to sleep for 11 seconds 00000100:00100000:3.0:1789048585.843727:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111386752 00000100:00100000:3.0:1789048585.843737:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111386752 00000100:00100000:3.0:1789048585.843792:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1789048585.843802:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:13773:x1875953111386752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048585.843954:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:13773:x1875953111386752:12345-0@lo:502:llog_process_th.0 Request processed in 152us (7046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048585.843962:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1789048585.844216:0:13773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:13773:1875953111386752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789048585.844251:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789048585.844259:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048585.844261:0:13773:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789048585.844267:0:13773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789048585.844451:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1789048585.844470:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789048585.844481:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba1a00/0x133f221c087760af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087760b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.844493:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b07ba1a00/0x133f221c087760af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087760b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048585.844503:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789048585.844506:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c41779800 from 7 10000000:01000000:3.0:1789048585.844509:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789048585.844539:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c200/0x133f221c087760bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.844546:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c200/0x133f221c087760bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.844555:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c200/0x133f221c087760bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048585.844588:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111386880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789048585.844632:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048585.844657:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3c48ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048585.844670:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111386880 00000100:00100000:3.0:1789048585.844674:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111386880 00000100:00100000:3.0:1789048585.844694:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789048585.844701:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:6494:x1875953111386880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048585.844710:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048585.844722:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef3dc00/0x133f221c087760c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087760bd expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.844742:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3dc00/0x133f221c087760c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087760bd expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.844752:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef3dc00/0x133f221c087760c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087760bd expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.844761:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3dc00, rc 0) 00000100:00100000:3.0:1789048585.844791:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111386880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048585.844797:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789048585.844827:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111386880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048585.844839:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c200/0x133f221c087760bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087760c4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.844847:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c200/0x133f221c087760bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087760c4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048585.844891:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111387008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048585.844923:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048585.844936:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c42240 going to sleep for 11 seconds 00000100:00100000:3.0:1789048585.844947:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111387008 00000100:00100000:3.0:1789048585.844951:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111387008 00000100:00100000:3.0:1789048585.844967:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789048585.844972:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111387008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048585.845061:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111387008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048585.845068:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789048585.845096:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111387008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048585.845121:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111387136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789048585.845153:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048585.845166:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c42240 going to sleep for 11 seconds 00000100:00100000:3.0:1789048585.845176:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111387136 00000100:00100000:3.0:1789048585.845179:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111387136 00000100:00100000:3.0:1789048585.845195:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789048585.845200:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111387136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789048585.845264:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111387136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048585.845270:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789048585.845313:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111387136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048585.855749:0:13775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:13775:1875953111387264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789048585.855837:0:13775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048585.855880:0:13775:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88480 going to sleep for 11 seconds 00000100:00100000:1.0:1789048585.856317:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111387264 00000100:00100000:1.0:1789048585.856325:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111387264 00000100:00100000:1.0:1789048585.856414:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1789048585.856422:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:13775:x1875953111387264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048585.856553:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:13775:x1875953111387264:12345-0@lo:502:llog_process_th.0 Request processed in 130us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048585.856561:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789048585.857410:0:13775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:13775:1875953111387264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789048585.857449:0:13775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789048585.857459:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048585.857462:0:13775:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789048585.857470:0:13775:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959c41779800 00000020:00000080:2.0:1789048585.857473:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789048585.857535:0:13775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789048585.857538:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048585.857540:0:13775:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789048585.857542:0:13775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789048585.857544:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048585.857546:0:13775:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789048585.857549:0:13775:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959c41779800 00000020:00000080:2.0:1789048585.857551:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789048585.858557:0:13775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:13775:1875953111387392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789048585.859023:0:13775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048585.859084:0:13775:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88480 going to sleep for 11 seconds 00000100:00100000:3.0:1789048585.859575:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111387392 00000100:00100000:3.0:1789048585.859585:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111387392 00000100:00100000:3.0:1789048585.859636:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1789048585.859646:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:13775:x1875953111387392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048585.859777:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:13775:x1875953111387392:12345-0@lo:502:llog_process_th.0 Request processed in 132us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048585.859784:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1789048585.860350:0:13775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:13775:1875953111387392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789048585.860392:0:13775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789048585.860408:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048585.860411:0:13775:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789048585.860415:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789048585.861444:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1789048585.861474:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789048585.861485:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c200/0x133f221c087760bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087760c4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.861498:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c200/0x133f221c087760bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087760c4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048585.861509:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789048585.861512:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c414c7000 from 7 10000000:01000000:3.0:1789048585.861515:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789048585.861547:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ce00/0x133f221c087760cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.861555:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ce00/0x133f221c087760cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.861579:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ce00/0x133f221c087760cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048585.861602:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111387520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789048585.861654:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048585.861693:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c42a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789048585.862382:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111387520 00000100:00100000:2.0:1789048585.862391:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111387520 00000100:00100000:2.0:1789048585.862453:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789048585.862464:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:6494:x1875953111387520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048585.862478:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048585.862493:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c02837400/0x133f221c087760d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087760cb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048585.862518:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c02837400/0x133f221c087760d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087760cb expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048585.862529:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c02837400/0x133f221c087760d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087760cb expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048585.862537:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02837400, rc 0) 00000100:00100000:2.0:1789048585.863380:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111387520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 906us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048585.863390:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1789048585.864000:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111387520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048585.864023:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ce00/0x133f221c087760cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087760d2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.864041:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ce00/0x133f221c087760cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087760d2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048585.864120:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111387648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048585.864157:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048585.864206:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c42a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789048585.864416:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111387648 00000100:00100000:2.0:1789048585.864423:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111387648 00000100:00100000:2.0:1789048585.864461:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789048585.864470:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111387648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048585.864756:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111387648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048585.864769:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1789048585.864973:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111387648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048585.865009:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b082ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111387776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048585.865051:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048585.865084:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0793a840 going to sleep for 11 seconds 00000100:00100000:2.0:1789048585.866904:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111387776 00000100:00100000:2.0:1789048585.866917:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111387776 00000100:00100000:2.0:1789048585.866981:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1789048585.866991:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111387776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048585.867155:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111387776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (2102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048585.867165:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789048585.867932:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b082ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111387776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789048585.868885:0:13777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:13777:1875953111387904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048585.868952:0:13777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048585.868997:0:13777:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c429c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048585.869045:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111387904 00000100:00100000:0.0:1789048585.869051:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111387904 00000100:00100000:0.0:1789048585.869092:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1789048585.869100:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:13777:x1875953111387904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048585.869761:0:13777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:13777:1875953111387904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789048585.869793:0:13777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048585.869803:0:13777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048585.869805:0:13777:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789048585.869812:0:13777:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959c414c7000 00000020:00000080:3.0:1789048585.869815:0:13777:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789048585.869876:0:13777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048585.870156:0:13777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048585.870159:0:13777:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789048585.870163:0:13777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048585.870166:0:13777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048585.870167:0:13777:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789048585.870171:0:13777:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959c414c7000 00000020:00000080:3.0:1789048585.870173:0:13777:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789048585.870714:0:13777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:13777:1875953111388032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048585.870858:0:13777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048585.870893:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111388032 00000100:00100000:3.0:1789048585.870898:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111388032 00000100:00100000:3.0:1789048585.870943:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1789048585.870951:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:13777:x1875953111388032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048585.871046:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:13777:x1875953111388032:12345-0@lo:502:llog_process_th.0 Request processed in 95us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048585.871053:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1789048585.871107:0:13777:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c429c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048585.871124:0:13777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:13777:1875953111388032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789048585.871145:0:13777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048585.871151:0:13777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048585.871153:0:13777:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789048585.871156:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000100:00100000:0.0:1789048585.871805:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:13777:x1875953111387904:12345-0@lo:502:llog_process_th.0 Request processed in 2700us (2848us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048585.871813:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000020:01000000:0.0:1789048585.871845:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789048585.871871:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789048585.871881:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ce00/0x133f221c087760cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087760d2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048585.871894:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ce00/0x133f221c087760cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087760d2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048585.871904:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789048585.871915:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c335d0800 from 7 10000000:01000000:0.0:1789048585.871918:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789048585.871948:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39400/0x133f221c087760d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048585.871956:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef39400/0x133f221c087760d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048585.871965:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef39400/0x133f221c087760d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048585.871981:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111388160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789048585.872018:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048585.872087:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f900 going to sleep for 11 seconds 00000100:00100000:0.0:1789048585.872109:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111388160 00000100:00100000:0.0:1789048585.872114:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111388160 00000100:00100000:3.0:1789048585.872155:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1789048585.872165:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:6494:x1875953111388160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048585.872176:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048585.872199:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef3cc00/0x133f221c087760e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087760d9 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.872226:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3cc00/0x133f221c087760e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087760d9 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.872237:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef3cc00/0x133f221c087760e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087760d9 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.872245:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3cc00, rc 0) 00000100:00100000:3.0:1789048585.872298:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:6494:x1875953111388160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048585.872304:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1789048585.872507:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111388160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048585.872523:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef39400/0x133f221c087760d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087760e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048585.872531:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef39400/0x133f221c087760d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087760e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048585.872596:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111388288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048585.872624:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048585.872645:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88600 going to sleep for 11 seconds 00000100:00100000:3.0:1789048585.872806:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111388288 00000100:00100000:3.0:1789048585.872817:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111388288 00000100:00100000:3.0:1789048585.872851:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1789048585.872859:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:6494:x1875953111388288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048585.872962:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:6494:x1875953111388288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048585.872969:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1789048585.873109:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111388288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048585.873136:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111388416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048585.873171:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048585.873197:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88600 going to sleep for 11 seconds 00000100:00100000:3.0:1789048585.873271:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111388416 00000100:00100000:3.0:1789048585.873275:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111388416 00000100:00100000:3.0:1789048585.873308:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1789048585.873313:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:6494:x1875953111388416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789048585.873724:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:6494:x1875953111388416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 409us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048585.873730:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1789048585.873817:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:6494:1875953111388416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048585.874116:0:13778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:13778:1875953111388544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789048585.874154:0:13778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048585.874178:0:13778:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789048585.874287:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111388544 00000100:00100000:3.0:1789048585.875905:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111388544 00000100:00100000:3.0:1789048585.876014:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789048585.876026:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:13778:x1875953111388544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048585.876193:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:13778:x1875953111388544:12345-0@lo:502:llog_process_th.0 Request processed in 170us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048585.876201:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789048585.876264:0:13778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:13778:1875953111388544:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789048585.876308:0:13778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048585.876317:0:13778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048585.876323:0:13778:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789048585.876571:0:13778:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959c335d0800 00000020:00000080:3.0:1789048585.876577:0:13778:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789048585.876641:0:13778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048585.876963:0:13778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048585.876965:0:13778:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789048585.876970:0:13778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048585.876974:0:13778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048585.876975:0:13778:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789048585.876979:0:13778:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959c335d0800 00000020:00000080:3.0:1789048585.876981:0:13778:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789048585.877740:0:13778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:13778:1875953111388672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048585.877801:0:13778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048585.877830:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111388672 00000100:00100000:3.0:1789048585.877836:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111388672 00000100:00100000:3.0:1789048585.877870:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1789048585.877878:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:13778:x1875953111388672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048585.877986:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:13778:x1875953111388672:12345-0@lo:502:llog_process_th.0 Request processed in 108us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048585.877993:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1789048585.878040:0:13778:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c123b8540 going to sleep for 11 seconds 00000100:00100000:3.0:1789048585.878057:0:13778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:13778:1875953111388672:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789048585.878080:0:13778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048585.878085:0:13778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048585.878087:0:13778:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789048585.878090:0:13778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789048585.878161:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1789048585.878181:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789048585.878190:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39400/0x133f221c087760d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087760e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048585.878202:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef39400/0x133f221c087760d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087760e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789048585.887365:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789048585.908313:0:13781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789048586.206128:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048586.302853:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048586.303567:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097667456 00000100:00100000:3.0:1789048586.303584:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097667456 00000100:00100000:3.0:1789048586.303688:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 375 00000100:00100000:3.0:1789048586.303701:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:2393:x1875953097667456:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048586.303811:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:2393:x1875953097667456:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 112us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048586.303819:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 375 00000100:00100000:3.0:1789048586.306930:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048586.307109:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097667584 00000100:00100000:1.0:1789048586.307130:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097667584 00000100:00100000:1.0:1789048586.307228:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 241 00000100:00100000:1.0:1789048586.307242:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097667584:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048586.307450:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097667584:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 211us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048586.307460:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 241 00000100:00080000:0.0:1789048586.307807:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789048586.311961:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048586.312021:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048586.312053:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048586.312093:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048586.312140:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097667712 00000100:00100000:1.0:1789048586.312153:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097667712 00000100:00100000:1.0:1789048586.312220:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097667968 00000100:00100000:1.0:1789048586.312223:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097667968 00000100:00100000:1.0:1789048586.312245:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097668096 00000100:00100000:1.0:1789048586.312248:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097668096 00000100:00100000:0.0:1789048586.312446:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 242 00000100:00100000:3.0:1789048586.312509:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097667840 00000100:00100000:3.0:1789048586.312514:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097667840 00000100:00100000:3.0:1789048586.312553:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00100000:3.0:1789048586.312563:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097667840:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048586.312668:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097667840:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 106us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048586.312677:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00080000:3.0:1789048586.312850:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789048586.312855:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048586.312857:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789048586.313027:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 243 00000100:00100000:1.0:1789048586.313033:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097667968:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048586.313064:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097667968:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 32us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048586.313068:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 243 00000100:00100000:1.0:1789048586.313078:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 244 00000100:00100000:0.0:1789048586.315441:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097667712:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048586.315679:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097667712:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 3221us (3734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048586.315695:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 242 00000100:00100000:1.0:1789048586.317139:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097668096:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048586.317231:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097668096:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 4147us (5137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048586.317466:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 244 00000100:00100000:3.0:1789048586.878411:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048586.878557:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097668224 00000100:00100000:2.0:1789048586.878573:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097668224 00000100:00100000:2.0:1789048586.878666:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 376 00000100:00100000:2.0:1789048586.878678:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:6169:x1875953097668224:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048586.878704:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048586.878737:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c02837200/0x133f221c087760e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b296df expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048586.878776:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c02837200/0x133f221c087760e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296df expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048586.878790:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c02837200/0x133f221c087760e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296df expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048586.878801:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02837200, rc 0) 00000100:00100000:2.0:1789048586.878890:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:6169:x1875953097668224:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 214us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048586.878899:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 376 00000100:00100000:2.0:1789048586.896690:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048586.896893:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097668352 00000100:00100000:0.0:1789048586.896909:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097668352 00000100:00100000:0.0:1789048586.897026:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 377 00000100:00100000:0.0:1789048586.897040:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:6169:x1875953097668352:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048586.897458:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:6169:x1875953097668352:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 413us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048586.897491:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 377 00000100:00100000:0.0:1789048586.906710:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048586.908749:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097668480 00000100:00100000:3.0:1789048586.908770:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097668480 00000100:00100000:3.0:1789048586.909034:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 378 00000100:00100000:3.0:1789048586.909050:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:6169:x1875953097668480:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789048586.911232:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:6169:x1875953097668480:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 2170us (4525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048586.911266:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 378 00000040:00080000:0.0:1789048586.911429:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789048586.915276:0:13781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789048586.923692:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048586.923939:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097668608 00000100:00100000:0.0:1789048586.923954:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097668608 00000100:00100000:0.0:1789048586.924085:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 379 00000100:00100000:0.0:1789048586.924099:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:10796:x1875953097668608:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789048586.925634:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:10796:x1875953097668608:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 1524us (1945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048586.925651:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 379 00000100:00100000:1.0:1789048586.937484:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048586.937644:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097668736 00000100:00100000:3.0:1789048586.937660:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097668736 00000100:00100000:3.0:1789048586.937742:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 380 00000100:00100000:3.0:1789048586.937754:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:10796:x1875953097668736:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789048586.938391:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:10796:x1875953097668736:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 635us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048586.938404:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 380 00010000:00010000:2.0:1789048587.231814:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048587.741923:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111388800:0@lo:400:kworker.0 00000100:00100000:3.0:1789048587.741970:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111389312:0@lo:400:kworker.0 00000100:00100000:0.0:1789048587.742027:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111389056:0@lo:400:kworker.0 00000100:00100000:1.0:1789048587.742102:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111389184:0@lo:400:kworker.0 00000100:00100000:1.0:1789048587.744850:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048587.744850:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048587.749241:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048587.749541:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111388800 00000100:00100000:0.0:1789048587.749556:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111388800 00000100:00100000:0.0:1789048587.749636:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1789048587.749649:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3621:x1875953111388800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048587.749754:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3621:x1875953111388800:12345-0@lo:400:kworker.0 Request processed in 107us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048587.749762:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1789048587.750226:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111389056 00000100:00100000:0.0:1789048587.750232:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111389056 00000100:00100000:0.0:1789048587.750286:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789048587.750294:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111389056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048587.750363:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111389056:12345-0@lo:400:kworker.0 Request processed in 70us (5524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048587.750377:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789048587.750562:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0795aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111389696:0@lo:400:kworker.0 00000100:00100000:1.0:1789048587.750607:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048587.750637:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111390208:0@lo:400:kworker.0 00000100:00100000:1.0:1789048587.750661:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048587.750695:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111388928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048587.750726:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048587.750777:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111388928 00000100:00100000:1.0:1789048587.750783:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111388928 00000100:00100000:1.0:1789048587.750834:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789048587.750845:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111388928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789048587.750882:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048587.751024:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111389056:0@lo:400:kworker.0 00000100:00100000:0.0:1789048587.751035:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111389568:0@lo:400:kworker.0 00000100:00100000:0.0:1789048587.751072:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048587.751097:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111389952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789048587.751124:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048587.751145:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111390592:0@lo:400:kworker.0 00000100:00100000:0.0:1789048587.751194:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048587.751605:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111389952 00000100:00100000:0.0:1789048587.751612:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111389952 00000100:00100000:0.0:1789048587.751647:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789048587.751655:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111389952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789048587.751672:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048587.751718:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111389952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048587.751725:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:0.0:1789048587.751765:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08108a80 x1875953111389952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048587.751786:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111389952:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789048587.751817:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789048587.751831:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111389696 00000100:00100000:0.0:1789048587.751836:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111389696 00000100:00100000:0.0:1789048587.751866:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111390208 00000100:00100000:0.0:1789048587.751869:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111390208 00000100:00100000:0.0:1789048587.751882:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111389568 00000100:00100000:1.0:1789048587.752232:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111388928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048587.752242:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789048587.752283:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789048587.752293:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111389696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048587.752356:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111389696:12345-0@lo:400:kworker.0 Request processed in 65us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048587.752363:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789048587.752377:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789048587.752397:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111390208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048587.752429:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111390208:12345-0@lo:400:kworker.0 Request processed in 34us (1767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048587.752565:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111389568 00000100:00100000:0.0:1789048587.752592:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789048587.752598:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111389568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048587.752903:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111389568:12345-0@lo:400:kworker.0 Request processed in 304us (1830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048587.752910:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789048587.753091:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111389568:0@lo:400:kworker.0 00000100:00080000:0.0:1789048587.753116:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789048587.753121:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789048587.753163:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0795aa00 x1875953111389696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048587.753174:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0795aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111389696:0@lo:400:kworker.0 00000100:00100000:0.0:1789048587.753187:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111390208:0@lo:400:kworker.0 00010000:00080000:0.0:1789048587.753200:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d74700 x1875953111388928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048587.753217:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111388928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048587.753366:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111389184 00000100:00100000:0.0:1789048587.753372:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111389184 00000100:00100000:0.0:1789048587.753409:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789048587.753417:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111389184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048587.753536:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789048587.754300:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111389184:12345-0@lo:400:kworker.0 Request processed in 881us (9458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048587.754308:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789048587.754514:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111389184:0@lo:400:kworker.0 00000100:00100000:3.0:1789048587.754783:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048587.754923:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111390592 00000100:00100000:3.0:1789048587.754946:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111390592 00000100:00100000:3.0:1789048587.755594:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789048587.755608:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111390592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048587.755685:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111390592:12345-0@lo:400:kworker.0 Request processed in 81us (4490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048587.755691:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:3.0:1789048587.755752:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb9d500 x1875953111390592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048587.755768:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111390592:0@lo:400:kworker.0 00000100:00100000:3.0:1789048587.755821:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111389824:0@lo:400:kworker.0 00000100:00100000:3.0:1789048587.755867:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048587.755895:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111389824 00000100:00100000:3.0:1789048587.755920:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111389824 00000100:00100000:3.0:1789048587.756077:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789048587.756083:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111389824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048587.756119:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111389824:12345-0@lo:400:kworker.0 Request processed in 37us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048587.756126:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1789048587.756146:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789048587.756167:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111389824:0@lo:400:kworker.0 00000100:00100000:3.0:1789048587.756175:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111390336:0@lo:400:kworker.0 00000100:00100000:3.0:1789048587.756203:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048587.756543:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111388800:0@lo:400:kworker.0 00000100:00100000:2.0:1789048587.756553:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111389440:0@lo:400:kworker.0 00000100:00100000:2.0:1789048587.756723:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048587.756752:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111389440 00000100:00100000:2.0:1789048587.756757:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111389440 00000100:00100000:2.0:1789048587.756941:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789048587.756951:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111389440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048587.756994:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111389440:12345-0@lo:400:kworker.0 Request processed in 45us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048587.757001:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789048587.757047:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111389440:0@lo:400:kworker.0 00000100:00100000:2.0:1789048587.757054:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111390080:0@lo:400:kworker.0 00000100:00100000:2.0:1789048587.757081:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048587.757104:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111390080 00000100:00100000:2.0:1789048587.757107:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111390080 00000100:00100000:2.0:1789048587.757210:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789048587.757217:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111390080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048587.757246:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111390080:12345-0@lo:400:kworker.0 Request processed in 31us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048587.757252:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1789048587.757268:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048587.757298:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111390080:0@lo:400:kworker.0 00000100:00100000:2.0:1789048587.757317:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111390464:0@lo:400:kworker.0 00000100:00100000:0.0:1789048587.757942:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111389312 00000100:00100000:0.0:1789048587.757950:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111389312 00000100:00100000:0.0:1789048587.758002:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111390336 00000100:00100000:0.0:1789048587.758005:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111390336 00000100:00100000:0.0:1789048587.758040:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789048587.758048:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111389312:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789048587.763457:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789048587.766160:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789048587.766202:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111390336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048587.770778:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111389312:12345-0@lo:400:kworker.0 Request processed in 12715us (15980us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048587.770799:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789048587.771010:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111389312:0@lo:400:kworker.0 00000100:00100000:2.0:1789048587.771728:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048587.772220:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111390464 00000100:00100000:3.0:1789048587.772231:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111390464 00000100:00100000:3.0:1789048587.772314:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789048587.772579:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111390464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048587.772947:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111390464:12345-0@lo:400:kworker.0 Request processed in 623us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048587.772956:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789048587.774700:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111390336:12345-0@lo:400:kworker.0 Request processed in 8511us (18483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048587.774719:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00010000:00080000:3.0:1789048587.774865:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0747ca80 x1875953111390336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048587.774882:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111390336:0@lo:400:kworker.0 00010000:00080000:2.0:1789048587.775566:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0747c000 x1875953111390464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048587.775579:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111390464:0@lo:400:kworker.0 00010000:00010000:2.0:1789048588.253771:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048588.254050:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111390720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048588.254175:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048588.254426:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111390720 00000100:00100000:3.0:1789048588.254439:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111390720 00000100:00100000:3.0:1789048588.254523:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789048588.254537:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111390720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789048588.254627:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789048588.254700:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111390720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 166us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048588.254708:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789048588.254891:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111390720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048588.765612:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111390848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789048588.765714:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048588.765835:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111390976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048588.765888:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048588.772197:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111390848 00000100:00100000:1.0:1789048588.772203:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111390976 00000100:00100000:3.0:1789048588.772219:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111390848 00000100:00100000:1.0:1789048588.772219:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111390976 00000100:00100000:1.0:1789048588.772410:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789048588.772423:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111390976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789048588.772470:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048588.772596:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111390976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 177us (6708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048588.772605:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789048588.772629:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789048588.772638:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111390848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789048588.772651:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048588.772689:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111390848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (6975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048588.772718:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789048588.772771:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111390848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789048588.773053:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111390976:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789048589.278209:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789048589.291175:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1789048589.789738:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111391104:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048589.789850:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048589.790050:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111391104 00000100:00100000:1.0:1789048589.790063:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111391104 00000100:00100000:1.0:1789048589.790137:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789048589.790149:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111391104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789048589.790196:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789048589.790299:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111391104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048589.790308:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789048589.790503:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111391104:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789048590.303144:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048591.326095:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048591.424697:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048591.424753:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048591.424775:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048591.424816:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048591.424829:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048591.424846:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048591.424969:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097668992 00000100:00100000:0.0:1789048591.424981:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097668992 00000100:00100000:0.0:1789048591.425050:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097669504 00000100:00100000:0.0:1789048591.425052:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097669504 00000100:00100000:0.0:1789048591.425061:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097669120 00000100:00100000:0.0:1789048591.425062:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097669120 00000100:00100000:0.0:1789048591.425072:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097669376 00000100:00100000:0.0:1789048591.425074:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097669376 00000100:00100000:0.0:1789048591.425085:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 251 00000100:00100000:0.0:1789048591.425095:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2392:x1875953097668992:12345-192.168.202.16@tcp:400:kworker.0 00000100:00080000:1.0:1789048591.425249:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789048591.425255:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789048591.425273:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 252 00000100:00100000:1.0:1789048591.425287:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2392:x1875953097669504:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048591.425667:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 253 00000100:00100000:2.0:1789048591.425680:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2392:x1875953097669120:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048591.426921:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097669248 00000100:00100000:3.0:1789048591.426948:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097669248 00000100:00100000:3.0:1789048591.427023:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 86 00000100:00100000:3.0:1789048591.427031:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2392:x1875953097669248:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048591.427193:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2392:x1875953097668992:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 2098us (2508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048591.427203:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 251 00000100:00100000:0.0:1789048591.427229:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 254 00000100:00100000:0.0:1789048591.427245:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2392:x1875953097669376:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048591.427283:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2392:x1875953097669376:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 48us (2434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048591.427309:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 254 00000100:00100000:0.0:1789048591.427566:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097668864 00000100:00100000:0.0:1789048591.427572:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097668864 00000100:00100000:0.0:1789048591.427604:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 382 00000100:00100000:0.0:1789048591.427612:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2392:x1875953097668864:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048591.427645:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2392:x1875953097668864:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 34us (2827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048591.427651:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 382 00000100:00080000:0.0:1789048591.427713:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048591.430866:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2392:x1875953097669120:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 5166us (6009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048591.430890:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 253 00000100:00100000:1.0:1789048591.431624:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2392:x1875953097669504:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 6334us (6840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048591.431636:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 252 00000100:00100000:3.0:1789048591.434621:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2392:x1875953097669248:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 7571us (9847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048591.434639:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 86 00010000:00010000:0.0:1789048592.349860:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048592.862389:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111391232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048592.862496:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048592.862582:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111391360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048592.862598:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0822a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111391744:0@lo:400:kworker.0 00000100:00100000:1.0:1789048592.862641:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048592.862645:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048592.862674:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0822aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111392256:0@lo:400:kworker.0 00000100:00100000:1.0:1789048592.862679:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111391872:0@lo:400:kworker.0 00000100:00100000:1.0:1789048592.862712:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048592.862731:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111391232 00000100:00100000:1.0:1789048592.862731:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111392384:0@lo:400:kworker.0 00000100:00100000:3.0:1789048592.862743:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111391232 00000100:00100000:1.0:1789048592.862750:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048592.862763:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111392896:0@lo:400:kworker.0 00000100:00100000:1.0:1789048592.862780:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048592.862813:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111392384 00000100:00100000:3.0:1789048592.862815:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111391360 00000100:00100000:1.0:1789048592.862817:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111392384 00000100:00100000:3.0:1789048592.862821:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111391360 00000100:00100000:1.0:1789048592.862847:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111392896 00000100:00100000:1.0:1789048592.862851:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111392896 00000100:00100000:1.0:1789048592.862868:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789048592.862875:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111392384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048592.862920:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789048592.862922:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111392384:12345-0@lo:400:kworker.0 Request processed in 46us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048592.862930:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789048592.862935:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1875953111391232:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048592.862959:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789048592.862965:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2ecbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3621:x1875953111392896:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1789048592.862981:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048592.862986:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2ecbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3621:x1875953111392896:12345-0@lo:400:kworker.0 Request processed in 21us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048592.862991:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789048592.863093:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111391232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 162us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048592.863102:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789048592.863123:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789048592.863132:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111391360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789048592.863145:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048592.863182:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111391360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048592.863190:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789048592.863270:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789048592.863272:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0810ad80 x1875953111391360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048592.863296:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111392768:0@lo:400:kworker.0 00000100:00100000:1.0:1789048592.863297:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111391360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789048592.863312:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111392384:0@lo:400:kworker.0 00010000:00080000:1.0:1789048592.863321:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3edcd180 x1875953111392896/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048592.863358:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111392896:0@lo:400:kworker.0 00000100:00100000:3.0:1789048592.863365:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789048592.863401:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fba6a00 x1875953111391232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048592.863417:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111391232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048592.863565:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111391616:0@lo:400:kworker.0 00000100:00100000:2.0:1789048592.863592:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111391488:0@lo:400:kworker.0 00000100:00100000:0.0:1789048592.863609:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048592.863638:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048592.863651:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875953111392128:0@lo:400:kworker.0 00000100:00100000:2.0:1789048592.863682:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0822b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111392000:0@lo:400:kworker.0 00000100:00100000:0.0:1789048592.863688:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048592.863711:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048592.863715:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111392640:0@lo:400:kworker.0 00000100:00100000:2.0:1789048592.863732:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111392512:0@lo:400:kworker.0 00000100:00100000:0.0:1789048592.863750:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048592.863758:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048592.863786:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111393024:0@lo:400:kworker.0 00000100:00100000:0.0:1789048592.863787:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111391872 00000100:00100000:0.0:1789048592.863795:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111391872 00000100:00100000:2.0:1789048592.863803:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048592.863831:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111392256 00000100:00100000:2.0:1789048592.863834:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111391744 00000100:00100000:0.0:1789048592.863835:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111392256 00000100:00100000:2.0:1789048592.863844:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111391744 00000100:00100000:2.0:1789048592.863869:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111392000 00000100:00100000:2.0:1789048592.863870:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111392000 00000100:00100000:2.0:1789048592.863879:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789048592.863883:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111391744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048592.863915:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111391744:12345-0@lo:400:kworker.0 Request processed in 31us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048592.863919:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789048592.863978:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789048592.863984:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111392000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048592.864011:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111392000:12345-0@lo:400:kworker.0 Request processed in 27us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048592.864017:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789048592.864036:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111392512 00000100:00100000:2.0:1789048592.864039:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111392512 00000100:00100000:0.0:1789048592.864067:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111392768 00000100:00100000:0.0:1789048592.864072:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111392768 00000100:00100000:1.0:1789048592.864087:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111391616 00000100:00100000:1.0:1789048592.864092:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111391616 00000100:00100000:1.0:1789048592.864245:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111392128 00000100:00100000:1.0:1789048592.864250:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111392128 00000100:00100000:3.0:1789048592.864258:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111391488 00000100:00100000:3.0:1789048592.864265:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111391488 00000100:00100000:2.0:1789048592.864299:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111393024 00000100:00100000:2.0:1789048592.864303:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111393024 00000100:00100000:3.0:1789048592.864308:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789048592.864316:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789048592.864320:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111391488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048592.864326:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111392512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048592.864397:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111391488:12345-0@lo:400:kworker.0 Request processed in 79us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048592.864398:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111392512:12345-0@lo:400:kworker.0 Request processed in 75us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048592.864409:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789048592.864415:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789048592.864420:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789048592.864426:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111393024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048592.864457:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111393024:12345-0@lo:400:kworker.0 Request processed in 32us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048592.864462:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789048592.864523:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0822a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111391744:0@lo:400:kworker.0 00000100:00100000:2.0:1789048592.868322:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111391488:0@lo:400:kworker.0 00000100:00100000:2.0:1789048592.868358:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0822b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111392000:0@lo:400:kworker.0 00000100:00100000:2.0:1789048592.868370:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1789048592.868375:0:3622:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff959b080e5180, transno 4294967301 00000100:00100000:2.0:1789048592.868390:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111392512:0@lo:400:kworker.0 00010000:00080000:2.0:1789048592.868402:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3edcf800 x1875953111393024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048592.868410:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111393024:0@lo:400:kworker.0 00000100:00100000:0.0:1789048592.869174:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111392640 00000100:00100000:0.0:1789048592.869186:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111392640 00000100:00100000:0.0:1789048592.869219:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789048592.869701:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111391872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048592.869876:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111391872:12345-0@lo:400:kworker.0 Request processed in 179us (7160us total) trans 0 rc 0/0 00000100:00080000:2.0:1789048592.870577:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789048592.870586:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789048592.870591:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789048592.870594:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789048592.870732:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111391872:0@lo:400:kworker.0 00000100:00100000:3.0:1789048592.870991:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789048592.871082:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111392256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048592.871166:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111392256:12345-0@lo:400:kworker.0 Request processed in 89us (7897us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048592.871174:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789048592.871401:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789048592.871677:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111391616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048592.871829:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111391616:12345-0@lo:400:kworker.0 Request processed in 264us (8221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048592.871836:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789048592.874553:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789048592.874590:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111392768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048592.875279:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789048592.875292:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789048592.875313:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111392640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048592.875419:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789048592.875431:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875953111392128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048592.876578:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07bf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111391616:0@lo:400:kworker.0 00000100:00100000:2.0:1789048592.876622:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111392640:12345-0@lo:400:kworker.0 Request processed in 1317us (12871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048592.876629:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111392640:0@lo:400:kworker.0 00000100:00100000:2.0:1789048592.876632:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00080000:2.0:1789048592.876667:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789048592.876722:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0822aa00 x1875953111392256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048592.876732:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0822aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111392256:0@lo:400:kworker.0 00000100:00100000:1.0:1789048592.877218:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875953111392128:12345-0@lo:400:kworker.0 Request processed in 1788us (13530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048592.877238:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789048592.877259:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875953111392128:0@lo:400:kworker.0 00000100:00100000:3.0:1789048592.879571:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111392768:12345-0@lo:400:kworker.0 Request processed in 4989us (16227us total) trans 0 rc 0/0 00010000:00080000:2.0:1789048592.879571:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3edcd500 x1875953111392768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048592.879593:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789048592.879596:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111392768:0@lo:400:kworker.0 00010000:00010000:2.0:1789048593.373815:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048593.374205:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111393152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789048593.374313:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048593.374552:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111393152 00000100:00100000:3.0:1789048593.374563:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111393152 00000100:00100000:3.0:1789048593.374629:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789048593.374641:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111393152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789048593.374689:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789048593.374756:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111393152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048593.374764:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789048593.374862:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111393152:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048593.886694:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111393280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789048593.886800:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048593.886917:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111393280 00000100:00100000:2.0:1789048593.886917:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789048593.886929:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111393280 00000100:00100000:2.0:1789048593.886929:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111393408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048593.886970:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048593.887041:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111393408 00000100:00100000:3.0:1789048593.887045:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111393408 00000100:00100000:3.0:1789048593.887089:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789048593.887100:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111393280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789048593.887141:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048593.887239:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111393280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048593.887248:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789048593.887278:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789048593.887286:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111393408:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789048593.887292:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111393280:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789048593.887297:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048593.887351:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111393408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048593.887359:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789048593.887363:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111393408:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789048594.400365:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048594.909701:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111393536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789048594.909802:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048594.909954:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111393536 00000100:00100000:0.0:1789048594.909966:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111393536 00000100:00100000:0.0:1789048594.910041:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789048594.910065:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111393536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789048594.910113:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789048594.912307:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111393536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2242us (2492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048594.912323:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789048594.915567:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111393536:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789048595.424541:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789048596.126752:0:13781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789048596.127472:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789048596.445846:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048596.543033:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048596.543106:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048596.543172:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048596.544878:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097669760 00000100:00100000:3.0:1789048596.544899:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097669760 00000100:00100000:3.0:1789048596.545071:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097669888 00000100:00100000:3.0:1789048596.545075:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097669888 00000100:00100000:3.0:1789048596.545121:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 261 00000100:00100000:3.0:1789048596.545164:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097669760:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048596.545313:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097669760:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 166us (2296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048596.545322:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 261 00000100:00100000:3.0:1789048596.545386:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 262 00000100:00100000:3.0:1789048596.545394:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097669888:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048596.545425:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097669888:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 32us (2271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048596.545453:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 262 00000100:00100000:2.0:1789048596.545706:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097669632 00000100:00100000:2.0:1789048596.545714:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097669632 00000100:00100000:2.0:1789048596.545799:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 384 00000100:00100000:2.0:1789048596.545807:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2394:x1875953097669632:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048596.545836:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2394:x1875953097669632:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 32us (2730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048596.545841:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 384 00000100:00080000:0.0:1789048596.546258:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789048596.546266:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789048596.556822:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048596.556873:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048596.556951:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048596.557121:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097670144 00000100:00100000:1.0:1789048596.557135:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097670144 00000100:00100000:1.0:1789048596.557226:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097670272 00000100:00100000:1.0:1789048596.557230:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097670272 00000100:00100000:1.0:1789048596.557273:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 263 00000100:00100000:1.0:1789048596.557286:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097670144:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048596.557426:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097670144:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 142us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048596.557436:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 263 00000100:00100000:1.0:1789048596.557456:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 264 00000100:00100000:1.0:1789048596.557463:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097670272:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048596.557497:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097670272:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 35us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048596.557505:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 264 00000100:00100000:3.0:1789048596.558081:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097670016 00000100:00100000:3.0:1789048596.558088:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097670016 00000100:00100000:3.0:1789048596.558145:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:3.0:1789048596.558153:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2390:x1875953097670016:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:3.0:1789048596.558195:0:8413:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08776007 00000100:00080000:3.0:1789048596.558207:0:8413:0:(import.c:65:import_set_state_nolock()) ffff959c3fb47800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789048596.558280:0:8413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1789048596.558502:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+2:2390:x1875953097670016:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 350us (1699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048596.558512:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00080000:0.0:1789048596.559070:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789048596.559078:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789048596.559081:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789048596.559139:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048597.469750:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048597.981721:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111393792:0@lo:400:kworker.0 00000100:00100000:1.0:1789048597.981826:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048597.981891:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111394304:0@lo:400:kworker.0 00000100:00100000:1.0:1789048597.981910:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048597.981932:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111394816:0@lo:400:kworker.0 00000100:00100000:1.0:1789048597.981949:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048597.981976:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789048597.981982:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111393920:0@lo:400:kworker.0 00000100:00100000:1.0:1789048597.982014:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048597.982029:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111394432:0@lo:400:kworker.0 00000100:00100000:1.0:1789048597.982056:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048597.982070:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111394944:0@lo:400:kworker.0 00000100:00100000:1.0:1789048597.982086:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048597.982122:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111393920 00000100:00100000:1.0:1789048597.982131:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111393920 00000100:00100000:1.0:1789048597.982215:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789048597.982490:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111393920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048597.982610:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111393920:12345-0@lo:400:kworker.0 Request processed in 386us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048597.982618:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789048597.982648:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111393792 00000100:00100000:1.0:1789048597.982667:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111393792 00000100:00100000:1.0:1789048597.982690:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111394304 00000100:00100000:1.0:1789048597.982692:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111394304 00000100:00100000:1.0:1789048597.982712:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111394816 00000100:00100000:1.0:1789048597.982714:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111394816 00000100:00100000:1.0:1789048597.982725:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111394432 00000100:00100000:1.0:1789048597.982727:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111394432 00000100:00100000:1.0:1789048597.982738:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111394944 00000100:00100000:1.0:1789048597.982740:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111394944 00000100:00100000:1.0:1789048597.982753:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789048597.982758:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111393792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048597.982895:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111394048:0@lo:400:kworker.0 00000100:00100000:0.0:1789048597.982933:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048597.982950:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111394560:0@lo:400:kworker.0 00000100:00100000:0.0:1789048597.982973:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048597.982989:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111395072:0@lo:400:kworker.0 00000100:00100000:0.0:1789048597.983007:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048597.983043:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789048597.983049:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111393664:0@lo:400:kworker.0 00000100:00100000:0.0:1789048597.983077:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048597.983095:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111394176:0@lo:400:kworker.0 00000100:00100000:0.0:1789048597.983116:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048597.983131:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111394688:0@lo:400:kworker.0 00000100:00100000:0.0:1789048597.983148:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048597.983165:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111395200:0@lo:400:kworker.0 00000100:00100000:0.0:1789048597.983195:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048597.983438:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111394176 00000100:00100000:0.0:1789048597.983445:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111394176 00000100:00100000:0.0:1789048597.983481:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789048597.983488:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111394176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048597.983543:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111394176:12345-0@lo:400:kworker.0 Request processed in 55us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048597.983564:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789048597.983589:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111394048 00000100:00100000:0.0:1789048597.983593:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111394048 00000100:00100000:0.0:1789048597.983611:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789048597.983617:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111394304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048597.983744:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111394560 00000100:00100000:3.0:1789048597.983750:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111394560 00000100:00100000:3.0:1789048597.983776:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111395072 00000100:00100000:3.0:1789048597.983779:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111395072 00000100:00100000:3.0:1789048597.983804:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111394688 00000100:00100000:3.0:1789048597.983807:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111394688 00000100:00100000:3.0:1789048597.983819:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111395200 00000100:00100000:3.0:1789048597.983822:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111395200 00000100:00100000:3.0:1789048597.983836:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789048597.983843:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111394560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048597.983881:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111394560:12345-0@lo:400:kworker.0 Request processed in 39us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048597.983888:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789048597.983901:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789048597.983906:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111395072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048597.983932:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111395072:12345-0@lo:400:kworker.0 Request processed in 25us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048597.983944:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789048597.983956:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789048597.983961:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111394688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048597.983989:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111394688:12345-0@lo:400:kworker.0 Request processed in 28us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048597.983995:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789048597.984006:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789048597.984011:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111395200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048597.984049:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111395200:12345-0@lo:400:kworker.0 Request processed in 38us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048597.984056:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1789048597.984103:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789048597.984108:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789048597.984111:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789048597.984114:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048597.984152:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111394176:0@lo:400:kworker.0 00000100:00100000:3.0:1789048597.984165:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111394688:0@lo:400:kworker.0 00010000:00080000:3.0:1789048597.984188:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3edcd500 x1875953111395200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048597.984201:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111395200:0@lo:400:kworker.0 00000100:00100000:3.0:1789048597.984212:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111394560:0@lo:400:kworker.0 00000100:00100000:1.0:1789048597.984495:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111393792:12345-0@lo:400:kworker.0 Request processed in 1734us (2667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048597.984505:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789048597.984587:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789048597.984598:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111394816:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789048597.984669:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3edce680 x1875953111395072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048597.984680:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111395072:0@lo:400:kworker.0 00000100:00100000:0.0:1789048597.990069:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111394304:12345-0@lo:400:kworker.0 Request processed in 6435us (8140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048597.990089:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789048597.990144:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789048597.990165:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0822aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111394432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048597.990281:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0822aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111394432:12345-0@lo:400:kworker.0 Request processed in 128us (8223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048597.990288:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789048597.990303:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789048597.990311:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111394944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048597.990363:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111394944:12345-0@lo:400:kworker.0 Request processed in 52us (8275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048597.990369:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789048597.990381:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789048597.990388:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111394048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048597.990443:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111394048:12345-0@lo:400:kworker.0 Request processed in 56us (7509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048597.990450:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789048597.990580:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111394048:0@lo:400:kworker.0 00000100:00100000:0.0:1789048597.990666:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111395456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048597.990710:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048597.990743:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789048597.990750:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111395328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789048597.990777:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048597.992090:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111395456 00000100:00100000:0.0:1789048597.992105:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111395456 00000100:00100000:0.0:1789048597.992163:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111395328 00000100:00100000:0.0:1789048597.992167:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111395328 00000100:00100000:0.0:1789048597.992198:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789048597.992208:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111395456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789048597.992418:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048597.992490:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111395456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 284us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048597.992498:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789048597.992516:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789048597.992524:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111395328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789048597.992535:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048597.992560:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111395328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (1783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048597.992567:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:0.0:1789048597.992613:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08108a80 x1875953111395328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048597.992634:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111395328:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789048597.992648:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fba5c00 x1875953111395456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048597.992679:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111395456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048597.995613:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111393664 00000100:00100000:0.0:1789048597.995635:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111393664 00000100:00100000:0.0:1789048597.995718:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1789048597.995730:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111393664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048597.996255:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111393664:12345-0@lo:400:kworker.0 Request processed in 525us (13173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048597.996265:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1789048597.996552:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111393664:0@lo:400:kworker.0 00000100:00100000:1.0:1789048598.001539:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111394816:12345-0@lo:400:kworker.0 Request processed in 16925us (19569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048598.001562:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789048598.001992:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111393920:0@lo:400:kworker.0 00010000:00080000:3.0:1789048598.002144:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3edcea00 x1875953111394432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048598.002157:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111394432:0@lo:400:kworker.0 00010000:00080000:3.0:1789048598.002183:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3edcca80 x1875953111394944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048598.002193:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111394944:0@lo:400:kworker.0 00000100:00100000:3.0:1789048598.002213:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111393792:0@lo:400:kworker.0 00000100:00100000:3.0:1789048598.002228:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111394304:0@lo:400:kworker.0 00000100:00100000:3.0:1789048598.002243:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111394816:0@lo:400:kworker.0 00000100:00100000:1.0:1789048598.495988:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789048598.496027:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111395584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048598.496210:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789048598.496601:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048598.500805:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111395584 00000100:00100000:3.0:1789048598.500830:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111395584 00000100:00100000:3.0:1789048598.501002:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789048598.501016:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0822b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111395584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789048598.501256:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789048598.501416:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0822b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111395584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 401us (5205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048598.501425:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789048598.501548:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111395584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789048599.006148:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789048599.006208:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111395840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789048599.006327:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048599.006505:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111395840 00000100:00100000:0.0:1789048599.006516:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111395840 00000100:00100000:0.0:1789048599.006587:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789048599.006599:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111395840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789048599.006638:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789048599.006641:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789048599.006668:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0822a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111395712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789048599.006690:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111395840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048599.006698:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789048599.006702:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048599.006720:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111395712 00000100:00100000:0.0:1789048599.006724:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111395712 00000100:00100000:0.0:1789048599.006753:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789048599.006759:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111395712:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789048599.006762:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789048599.006769:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048599.006828:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111395712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048599.006835:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789048599.006887:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111395840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048599.008264:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0822a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111395712:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789048599.517720:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048600.032086:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789048600.032123:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111395968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048600.032387:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048600.041796:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111395968 00000100:00100000:3.0:1789048600.041821:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111395968 00000100:00100000:3.0:1789048600.043698:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789048600.043728:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0822a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111395968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789048600.043783:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789048600.043920:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0822a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111395968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 206us (11534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048600.043928:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789048600.044120:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111395968:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789048600.542133:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048601.565728:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048601.663752:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048601.663809:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048601.663855:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048601.663889:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048601.663925:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048601.663964:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097670656 00000100:00100000:0.0:1789048601.663978:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097670656 00000100:00100000:2.0:1789048601.663991:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097670912 00000100:00100000:2.0:1789048601.663998:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097670912 00000100:00100000:3.0:1789048601.664081:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097670400 00000100:00100000:3.0:1789048601.664087:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097670400 00000100:00100000:3.0:1789048601.664148:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 386 00000100:00100000:2.0:1789048601.664156:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097670528 00000100:00100000:2.0:1789048601.664162:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097670528 00000100:00100000:3.0:1789048601.664164:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2394:x1875953097670400:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048601.664238:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097670784 00000100:00100000:1.0:1789048601.664244:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097670784 00000100:00100000:3.0:1789048601.664736:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2394:x1875953097670400:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 574us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048601.664752:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 386 00000100:00080000:3.0:1789048601.664808:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048601.664814:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048601.664860:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 271 00000100:00100000:3.0:1789048601.664871:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097670912:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048601.664919:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097670912:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 51us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048601.664934:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 271 00000100:00100000:2.0:1789048601.669596:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 272 00000100:00100000:2.0:1789048601.669629:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097670528:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048601.669752:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097670528:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 144us (5862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048601.669761:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 272 00000100:00100000:1.0:1789048601.670841:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 273 00000100:00100000:1.0:1789048601.670863:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097670784:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048601.670943:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097670784:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 90us (7016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048601.670965:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 273 00000100:00100000:0.0:1789048601.674263:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 274 00000100:00100000:0.0:1789048601.674299:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097670656:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048601.674438:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097670656:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 159us (10628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048601.674448:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 274 00000001:00100000:2.0:1789048602.083619:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 00000020:00000080:2.0:1789048602.083633:0:8407:0:(genops.c:885:class_export_put()) final put ffff959c3fb47000/85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 00000020:00000080:1.0:1789048602.084307:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3fb47000/85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b for lustre-OST0000 00000020:00000080:0.0:1789048602.084588:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c3fb47800 for lustre-OST0000 00010000:00010000:1.0:1789048602.589718:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048603.102144:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111396480:0@lo:400:kworker.0 00000100:00100000:1.0:1789048603.102241:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048603.102365:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111396992:0@lo:400:kworker.0 00000100:00100000:1.0:1789048603.102398:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048603.102417:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111397504:0@lo:400:kworker.0 00000100:00100000:1.0:1789048603.102441:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048603.102478:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789048603.102484:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111396352:0@lo:400:kworker.0 00000100:00100000:1.0:1789048603.102513:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048603.102531:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111396864:0@lo:400:kworker.0 00000100:00100000:1.0:1789048603.102553:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048603.102569:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111397376:0@lo:400:kworker.0 00000100:00100000:1.0:1789048603.102591:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048603.102699:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111396480 00000100:00100000:1.0:1789048603.102710:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111396480 00000100:00100000:1.0:1789048603.102777:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111396864 00000100:00100000:1.0:1789048603.102804:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111396864 00000100:00100000:1.0:1789048603.102837:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111397376 00000100:00100000:1.0:1789048603.102840:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111397376 00000100:00100000:1.0:1789048603.102860:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789048603.102870:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111396480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048603.102944:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111396480:12345-0@lo:400:kworker.0 Request processed in 74us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048603.102952:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789048603.103010:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111396480:0@lo:400:kworker.0 00000100:00100000:1.0:1789048603.103040:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789048603.103048:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111396864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048603.103083:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111396864:12345-0@lo:400:kworker.0 Request processed in 37us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048603.103090:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00010000:00080000:1.0:1789048603.103117:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080d9f80 x1875953111396864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048603.103144:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111396864:0@lo:400:kworker.0 00000100:00100000:1.0:1789048603.103165:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789048603.103173:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111397376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048603.103209:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111397376:12345-0@lo:400:kworker.0 Request processed in 37us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048603.103215:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00010000:00080000:1.0:1789048603.103241:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08090000 x1875953111397376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048603.103251:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111397376:0@lo:400:kworker.0 00000100:00100000:2.0:1789048603.103591:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0822ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111396096:0@lo:400:kworker.0 00000100:00100000:2.0:1789048603.103655:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048603.103698:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111396608:0@lo:400:kworker.0 00000100:00100000:2.0:1789048603.103725:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048603.103748:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111397120:0@lo:400:kworker.0 00000100:00100000:2.0:1789048603.103777:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048603.103795:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111397632:0@lo:400:kworker.0 00000100:00100000:2.0:1789048603.103815:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048603.103838:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789048603.103846:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0822a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111396224:0@lo:400:kworker.0 00000100:00100000:2.0:1789048603.103870:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048603.103890:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111396736:0@lo:400:kworker.0 00000100:00100000:2.0:1789048603.103912:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048603.103923:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111397248:0@lo:400:kworker.0 00000100:00100000:2.0:1789048603.103944:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048603.103970:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111396224 00000100:00100000:2.0:1789048603.103976:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111396224 00000100:00100000:2.0:1789048603.104005:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111396736 00000100:00100000:2.0:1789048603.104008:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111396736 00000100:00100000:2.0:1789048603.104023:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111397248 00000100:00100000:2.0:1789048603.104038:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111397248 00000100:00100000:2.0:1789048603.104061:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789048603.104068:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111396224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048603.104112:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111396224:12345-0@lo:400:kworker.0 Request processed in 44us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048603.104118:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789048603.104151:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789048603.104157:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111396736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048603.104187:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111396736:12345-0@lo:400:kworker.0 Request processed in 30us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048603.104193:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789048603.104203:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789048603.104209:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111397248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048603.104236:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111397248:12345-0@lo:400:kworker.0 Request processed in 27us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048603.104241:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789048603.104269:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111396352 00000100:00100000:2.0:1789048603.104273:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111396352 00000100:00100000:2.0:1789048603.104314:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111396608 00000100:00100000:2.0:1789048603.104318:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111396608 00000100:00100000:2.0:1789048603.104398:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789048603.104406:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111396352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048603.104446:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111396352:12345-0@lo:400:kworker.0 Request processed in 42us (1933us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048603.104453:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789048603.104464:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789048603.104470:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111396608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048603.104507:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111396608:12345-0@lo:400:kworker.0 Request processed in 36us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048603.104513:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789048603.104558:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0822a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111396224:0@lo:400:kworker.0 00000100:00100000:2.0:1789048603.104569:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111396736:0@lo:400:kworker.0 00000100:00100000:2.0:1789048603.104578:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111397248:0@lo:400:kworker.0 00000100:00100000:2.0:1789048603.104588:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111396608:0@lo:400:kworker.0 00000100:00100000:3.0:1789048603.104856:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111396992 00000100:00100000:3.0:1789048603.104862:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111396992 00000100:00100000:3.0:1789048603.104893:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111397504 00000100:00100000:3.0:1789048603.104896:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111397504 00000100:00100000:3.0:1789048603.104921:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111397120 00000100:00100000:3.0:1789048603.104924:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111397120 00000100:00100000:3.0:1789048603.104941:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111397632 00000100:00100000:3.0:1789048603.104944:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111397632 00000100:00100000:3.0:1789048603.104959:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789048603.104966:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111396992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048603.105013:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111396992:12345-0@lo:400:kworker.0 Request processed in 47us (2615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048603.105020:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789048603.105035:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789048603.105041:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111397504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048603.105069:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111397504:12345-0@lo:400:kworker.0 Request processed in 28us (2627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048603.105075:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789048603.105085:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789048603.105091:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08204380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111397120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048603.105140:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08204380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111397120:12345-0@lo:400:kworker.0 Request processed in 49us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048603.105145:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789048603.105160:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789048603.105166:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08207800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111397632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048603.105195:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08207800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111397632:12345-0@lo:400:kworker.0 Request processed in 30us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048603.105200:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1789048603.105230:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789048603.105234:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789048603.105237:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048603.105248:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789048603.105668:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111397120:0@lo:400:kworker.0 00010000:00080000:2.0:1789048603.105687:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c03e55f80 x1875953111397632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048603.105698:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111397632:0@lo:400:kworker.0 00000100:00100000:2.0:1789048603.105712:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789048603.105726:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111397760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048603.105768:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048603.110515:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111396096 00000100:00100000:1.0:1789048603.110543:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111396096 00000100:00100000:1.0:1789048603.110662:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1789048603.110675:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111396096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048603.110837:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111396096:12345-0@lo:400:kworker.0 Request processed in 156us (7172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048603.111025:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111397760 00000100:00100000:3.0:1789048603.111031:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111397760 00000100:00100000:3.0:1789048603.111070:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789048603.111078:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111397760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789048603.111113:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048603.111171:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111397760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (5401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048603.111179:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789048603.111300:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111396352:0@lo:400:kworker.0 00000100:00100000:3.0:1789048603.111322:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111396992:0@lo:400:kworker.0 00010000:00080000:3.0:1789048603.111382:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08093480 x1875953111397504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048603.111395:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111397504:0@lo:400:kworker.0 00000100:00100000:3.0:1789048603.111431:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789048603.111443:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111397888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048603.111491:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048603.112201:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1789048603.112424:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111397888 00000100:00100000:0.0:1789048603.112434:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111397888 00000100:00100000:0.0:1789048603.112494:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789048603.112505:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111397888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789048603.112532:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048603.112603:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111397888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048603.112611:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:1.0:1789048603.112734:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb9e680 x1875953111397888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048619 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048603.112756:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111397888:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789048603.113033:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb54e00 x1875953111397760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048619 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048603.113050:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111397760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048603.113066:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0822ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111396096:0@lo:400:kworker.0 00000100:00100000:2.0:1789048603.614582:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789048603.614614:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111398016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048603.614715:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048603.615191:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111398016 00000100:00100000:3.0:1789048603.615203:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111398016 00000100:00100000:3.0:1789048603.615276:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789048603.615289:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111398016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789048603.615363:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789048603.615456:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111398016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 170us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048603.615464:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789048603.615636:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111398016:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789048603.616128:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048604.128039:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111398144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789048604.128160:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048604.128328:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111398144 00000100:00100000:3.0:1789048604.128373:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111398144 00000100:00100000:3.0:1789048604.128444:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789048604.128454:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111398144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789048604.128495:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048604.128945:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111398144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 489us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048604.128954:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789048604.129268:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111398272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789048604.129314:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048604.129953:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111398272 00000100:00100000:3.0:1789048604.129962:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111398272 00000100:00100000:3.0:1789048604.130016:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789048604.130027:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111398272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789048604.130050:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048604.130131:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111398272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048604.130138:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789048604.130296:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111398272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048604.134701:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111398144:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789048604.638461:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048605.149807:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111398400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048605.149929:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048605.150328:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111398400 00000100:00100000:3.0:1789048605.150382:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111398400 00000100:00100000:3.0:1789048605.150447:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789048605.150460:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111398400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789048605.150514:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789048605.150581:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111398400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048605.150588:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789048605.150828:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111398400:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789048605.661519:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789048606.370785:0:13781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789048606.371120:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789048606.695271:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048606.786516:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048606.786583:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048606.786677:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097671168 00000100:00100000:3.0:1789048606.786687:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097671168 00000100:00100000:3.0:1789048606.786756:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 281 00000100:00100000:3.0:1789048606.786766:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2391:x1875953097671168:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048606.786841:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2391:x1875953097671168:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 77us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048606.786848:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 281 00000100:00080000:2.0:1789048606.787039:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789048606.787204:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097671040 00000100:00100000:0.0:1789048606.787209:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097671040 00000100:00100000:0.0:1789048606.787249:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 388 00000100:00100000:0.0:1789048606.787256:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2391:x1875953097671040:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048606.787298:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2391:x1875953097671040:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 43us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048606.787305:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 388 00000100:00100000:2.0:1789048606.788591:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048606.788634:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048606.788670:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048606.788755:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097671296 00000100:00100000:1.0:1789048606.788764:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097671296 00000100:00100000:1.0:1789048606.788824:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097671424 00000100:00100000:1.0:1789048606.788828:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097671424 00000100:00100000:1.0:1789048606.788847:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097671552 00000100:00100000:1.0:1789048606.788849:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097671552 00000100:00100000:1.0:1789048606.788863:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 282 00000100:00100000:1.0:1789048606.788870:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2392:x1875953097671296:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048606.788918:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2392:x1875953097671296:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 48us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048606.788935:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 282 00000100:00100000:1.0:1789048606.788953:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 283 00000100:00100000:1.0:1789048606.788960:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0822ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2392:x1875953097671424:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048606.788986:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0822ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2392:x1875953097671424:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048606.788992:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 283 00000100:00100000:1.0:1789048606.789003:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 284 00000100:00100000:1.0:1789048606.789010:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0822a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2392:x1875953097671552:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048606.789032:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0822a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2392:x1875953097671552:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 22us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048606.789037:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 284 00000100:00080000:2.0:1789048606.789221:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789048606.789225:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789048607.713397:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048608.223712:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111398528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048608.223809:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048608.224142:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111398528 00000100:00100000:0.0:1789048608.224152:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111398528 00000100:00100000:0.0:1789048608.224240:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789048608.224255:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111398528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789048608.224294:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048608.224377:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111398528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048608.224385:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1789048608.224413:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789048608.224455:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb9ed80 x1875953111398528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048624 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048608.224478:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111398528:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048608.224632:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111398656:0@lo:400:kworker.0 00000100:00100000:0.0:1789048608.224686:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048608.224715:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111399168:0@lo:400:kworker.0 00000100:00100000:0.0:1789048608.224775:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048608.224797:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111399680:0@lo:400:kworker.0 00000100:00100000:0.0:1789048608.224824:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048608.224846:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789048608.224852:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111398784:0@lo:400:kworker.0 00000100:00100000:0.0:1789048608.224877:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048608.224898:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111399296:0@lo:400:kworker.0 00000100:00100000:0.0:1789048608.224919:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048608.224937:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111399808:0@lo:400:kworker.0 00000100:00100000:0.0:1789048608.224958:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048608.233049:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111399680 00000100:00100000:1.0:1789048608.233071:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111399680 00000100:00100000:1.0:1789048608.233167:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789048608.233182:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111399680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048608.233302:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111399680:12345-0@lo:400:kworker.0 Request processed in 124us (8476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048608.233310:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789048608.233367:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111399168 00000100:00100000:1.0:1789048608.233372:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111399168 00000100:00100000:1.0:1789048608.233403:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789048608.233411:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111399168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048608.233449:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111399168:12345-0@lo:400:kworker.0 Request processed in 39us (8673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048608.233474:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789048608.233991:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111398912:0@lo:400:kworker.0 00000100:00100000:1.0:1789048608.234050:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048608.234102:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111399424:0@lo:400:kworker.0 00000100:00100000:1.0:1789048608.234134:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048608.234160:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111399936:0@lo:400:kworker.0 00000100:00100000:1.0:1789048608.234183:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048608.234219:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789048608.234227:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0795aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111399040:0@lo:400:kworker.0 00000100:00100000:1.0:1789048608.234249:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048608.234261:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111399552:0@lo:400:kworker.0 00000100:00100000:1.0:1789048608.234282:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048608.234302:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111400064:0@lo:400:kworker.0 00000100:00100000:1.0:1789048608.234324:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048608.234383:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111398784 00000100:00100000:1.0:1789048608.234390:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111398784 00000100:00100000:1.0:1789048608.234423:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111399296 00000100:00100000:1.0:1789048608.234427:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111399296 00000100:00100000:1.0:1789048608.234446:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111399808 00000100:00100000:1.0:1789048608.234448:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111399808 00000100:00100000:1.0:1789048608.234464:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111399424 00000100:00100000:1.0:1789048608.234466:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111399424 00000100:00100000:1.0:1789048608.234480:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111399936 00000100:00100000:1.0:1789048608.234482:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111399936 00000100:00100000:1.0:1789048608.234675:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111399040 00000100:00100000:1.0:1789048608.234679:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111399040 00000100:00100000:1.0:1789048608.234772:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789048608.234791:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111398784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048608.234847:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111398784:12345-0@lo:400:kworker.0 Request processed in 58us (9968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048608.234854:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789048608.234871:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789048608.234877:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111399296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048608.234907:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111399296:12345-0@lo:400:kworker.0 Request processed in 30us (9987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048608.234912:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789048608.235028:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789048608.235038:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111399808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048608.235083:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111399808:12345-0@lo:400:kworker.0 Request processed in 37us (10113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048608.235090:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789048608.235104:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789048608.235110:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111399424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048608.235150:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111399424:12345-0@lo:400:kworker.0 Request processed in 41us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048608.235156:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789048608.235168:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789048608.235175:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111399936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048608.235204:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111399936:12345-0@lo:400:kworker.0 Request processed in 30us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048608.235209:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789048608.235220:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789048608.235233:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111399040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048608.235264:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111399040:12345-0@lo:400:kworker.0 Request processed in 32us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048608.235270:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789048608.235296:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111399552 00000100:00100000:1.0:1789048608.235300:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111399552 00000100:00100000:1.0:1789048608.235359:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111400064 00000100:00100000:1.0:1789048608.235362:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111400064 00000100:00100000:1.0:1789048608.235386:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789048608.235392:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111399552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048608.235421:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111399552:12345-0@lo:400:kworker.0 Request processed in 30us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048608.235427:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789048608.235438:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789048608.235444:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111400064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048608.235469:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111400064:12345-0@lo:400:kworker.0 Request processed in 26us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048608.235475:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789048608.235772:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111398912 00000100:00100000:2.0:1789048608.235779:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111398912 00000100:00100000:2.0:1789048608.235819:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789048608.235828:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111398912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048608.235885:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111398912:12345-0@lo:400:kworker.0 Request processed in 59us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048608.235891:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789048608.236051:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0795aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111399040:0@lo:400:kworker.0 00000100:00100000:1.0:1789048608.236065:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111399552:0@lo:400:kworker.0 00010000:00080000:1.0:1789048608.236090:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080e7800 x1875953111400064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048608.236101:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111400064:0@lo:400:kworker.0 00000100:00100000:1.0:1789048608.236113:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111398912:0@lo:400:kworker.0 00010000:00080000:1.0:1789048608.236136:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080e5180 x1875953111399424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048608.236144:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111399424:0@lo:400:kworker.0 00010000:00080000:1.0:1789048608.236155:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080e5c00 x1875953111399936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048608.237049:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111399936:0@lo:400:kworker.0 00000100:00100000:1.0:1789048608.237184:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111400192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789048608.237253:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048608.237321:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111400192 00000100:00100000:1.0:1789048608.237322:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111398784:0@lo:400:kworker.0 00000100:00100000:2.0:1789048608.237331:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111400192 00000100:00100000:1.0:1789048608.237365:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111399296:0@lo:400:kworker.0 00000100:00100000:1.0:1789048608.237383:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111399808:0@lo:400:kworker.0 00000100:00100000:1.0:1789048608.237400:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111399168:0@lo:400:kworker.0 00000100:00100000:2.0:1789048608.237404:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789048608.237416:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111400192:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789048608.237419:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111399680:0@lo:400:kworker.0 00002000:00000024:2.0:1789048608.237444:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789048608.237474:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789048608.237482:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789048608.237505:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111400192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048608.237513:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:2.0:1789048608.237552:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d82300 x1875953111400192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048624 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048608.237568:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111400192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789048608.237964:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111398656 00000100:00100000:0.0:1789048608.237971:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111398656 00000100:00080000:1.0:1789048608.238011:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789048608.238016:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789048608.239404:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1789048608.239425:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111398656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048608.239538:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111398656:12345-0@lo:400:kworker.0 Request processed in 121us (14850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048608.239546:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1789048608.244527:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111398656:0@lo:400:kworker.0 00010000:00010000:2.0:1789048608.733733:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048608.739959:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111400320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048608.740065:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048608.740196:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111400320 00000100:00100000:2.0:1789048608.740209:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111400320 00000100:00100000:2.0:1789048608.740273:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789048608.740284:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111400320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789048608.740374:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789048608.746682:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111400320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6381us (6598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048608.746703:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789048608.746867:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111400320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048609.245680:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789048609.245718:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111400448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789048609.245838:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048609.245932:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111400448 00000100:00100000:1.0:1789048609.245943:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111400448 00000100:00100000:1.0:1789048609.246004:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789048609.246014:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111400448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789048609.246054:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048609.246133:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111400448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048609.246141:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789048609.246463:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111400448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789048609.247366:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111400576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048609.247430:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048609.249254:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111400576 00000100:00100000:3.0:1789048609.249275:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111400576 00000100:00100000:3.0:1789048609.249369:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789048609.249382:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111400576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789048609.249428:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048609.249525:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111400576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (2095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048609.249533:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789048609.250899:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111400576:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789048609.761511:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048610.269790:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789048610.269820:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111400704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048610.269901:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048610.270044:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111400704 00000100:00100000:2.0:1789048610.270062:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111400704 00000100:00100000:2.0:1789048610.270124:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789048610.270135:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111400704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789048610.270169:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789048610.270215:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111400704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048610.270223:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789048610.272440:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111400704:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789048610.781853:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789048611.570853:0:14042:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 09:56:50 (1789048610) 00010000:00010000:2.0:1789048611.805545:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048611.910460:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048611.910516:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048611.910565:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048611.910586:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048611.910610:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048611.910769:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097671680 00000100:00100000:0.0:1789048611.910780:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097671680 00000100:00100000:0.0:1789048611.910846:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 390 00000100:00100000:0.0:1789048611.910856:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2391:x1875953097671680:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048611.910937:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2391:x1875953097671680:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 82us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048611.910944:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 390 00000100:00100000:3.0:1789048611.911100:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097671808 00000100:00100000:3.0:1789048611.911105:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097671808 00000100:00100000:3.0:1789048611.911153:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097672064 00000100:00100000:3.0:1789048611.911156:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097672064 00000100:00100000:3.0:1789048611.911170:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097671936 00000100:00100000:3.0:1789048611.911172:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097671936 00000100:00100000:3.0:1789048611.911183:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097672192 00000100:00100000:3.0:1789048611.911186:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097672192 00000100:00100000:3.0:1789048611.911202:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 291 00000100:00100000:3.0:1789048611.911209:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2391:x1875953097671808:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048611.911253:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2391:x1875953097671808:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 45us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048611.911274:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 291 00000100:00100000:3.0:1789048611.911289:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 292 00000100:00100000:3.0:1789048611.911296:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2391:x1875953097672064:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048611.911320:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2391:x1875953097672064:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 25us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048611.911325:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 292 00000100:00100000:3.0:1789048611.911363:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 293 00000100:00100000:3.0:1789048611.911370:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2391:x1875953097671936:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048611.911395:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2391:x1875953097671936:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048611.911401:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 293 00000100:00100000:3.0:1789048611.911413:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 294 00000100:00100000:3.0:1789048611.911420:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2391:x1875953097672192:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048611.911442:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2391:x1875953097672192:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 23us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048611.911447:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 294 00000100:00080000:0.0:1789048611.911699:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789048611.911710:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789048612.829587:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048612.988601:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048612.988872:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097672320 00000100:00100000:3.0:1789048612.988882:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097672320 00000100:00100000:3.0:1789048612.988951:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:3.0:1789048612.988962:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:11086:x1875953097672320:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789048612.988984:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048612.989011:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c087760ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b296e6 expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048612.989382:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c087760f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048612.989399:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c087760f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048612.989414:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c087760f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048612.989464:0:8649:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789048612.989469:0:8649:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789048612.989508:0:8649:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c087760f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048612.989534:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c087760ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296e6 expref: 7 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048612.989554:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c087760f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296e6 expref: 6 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048612.989563:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c09e4f900) 00010000:00010000:3.0:1789048612.989566:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789048612.989570:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3da00, rc 0) 00000100:00100000:3.0:1789048612.989773:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:11086:x1875953097672320:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 811us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048612.989780:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:2.0:1789048613.003050:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048613.003306:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097672448 00000100:00100000:1.0:1789048613.003316:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097672448 00000100:00100000:1.0:1789048613.003427:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:1.0:1789048613.003439:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:11087:x1875953097672448:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789048613.003459:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048613.003482:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087760fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b296ed expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789048613.003552:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789048613.003556:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776103 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.003595:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776103 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.003611:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776103 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.003630:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c0877610a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.003637:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c0877610a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.003643:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c0877610a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.003923:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c08776111 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.003932:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c08776111 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.003940:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c08776111 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048613.003979:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789048613.003982:0:12131:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789048613.004002:0:12131:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c08776111 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.004010:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776103 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.004035:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776103 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.004042:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776103 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.004048:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048613.004052:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776103 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.004060:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776103 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.004085:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c09e4f900) 00010000:00010000:1.0:1789048613.004088:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048613.004094:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776103 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.004099:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776103 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.004111:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c0877610a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.004114:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c0877610a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.004118:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c0877610a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.004121:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048613.004128:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c0877610a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.004132:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c0877610a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.004234:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff959c3ef48100) 00010000:00010000:1.0:1789048613.004238:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048613.004241:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c0877610a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.004248:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c0877610a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.004281:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087760fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296ed expref: 8 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.004292:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c08776111 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296ed expref: 7 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048613.004296:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff959c3ef48300) 00010000:00010000:1.0:1789048613.004298:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789048613.004299:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1400, rc 0) 00000100:00100000:1.0:1789048613.004386:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:11087:x1875953097672448:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 951us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048613.004391:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:2.0:1789048613.010285:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048613.010434:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097672576 00000100:00100000:1.0:1789048613.010456:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097672576 00000100:00100000:1.0:1789048613.010611:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:1.0:1789048613.010623:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:11087:x1875953097672576:12345-192.168.202.16@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789048613.010747:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:11087:x1875953097672576:12345-192.168.202.16@tcp:900:lhsmtool_posix.0 Request processed in 125us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048613.010755:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:0.0:1789048613.013044:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048613.013161:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097672832 00000100:00100000:2.0:1789048613.013170:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097672832 00000100:00100000:2.0:1789048613.013223:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:2.0:1789048613.013232:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:11087:x1875953097672832:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789048613.013255:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048613.013276:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08776118 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b296f4 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013370:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c0877611f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013384:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c0877611f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013396:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c0877611f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013465:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776126 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013488:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776126 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013495:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776126 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013608:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837000/0x133f221c0877612d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013617:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837000/0x133f221c0877612d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013624:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837000/0x133f221c0877612d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048613.013634:0:6499:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789048613.013709:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c0877611f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013717:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c0877611f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013724:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c0877611f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013729:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048613.013733:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c0877611f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013740:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c0877611f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013760:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff959c3ef48300) 00010000:00010000:2.0:1789048613.013763:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048613.013768:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c0877611f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013774:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c0877611f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013788:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776126 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013794:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776126 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013800:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776126 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013805:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048613.013808:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776126 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013814:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776126 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013819:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff959c05322600) 00010000:00010000:2.0:1789048613.013822:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048613.013824:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776126 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.013829:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776126 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.014176:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08776118 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296f4 expref: 10 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.014192:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837000/0x133f221c0877612d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296f4 expref: 9 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048613.014199:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff959c05322a00) 00010000:00010000:2.0:1789048613.014201:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048613.014203:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02837000, rc 0) 00000100:00100000:2.0:1789048613.014264:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:11087:x1875953097672832:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 1034us (1239us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789048613.014271:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:3.0:1789048613.021271:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048613.021367:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097672960 00000100:00100000:1.0:1789048613.021377:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097672960 00000100:00100000:1.0:1789048613.021493:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:1.0:1789048613.021504:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:11087:x1875953097672960:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789048613.021625:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:11087:x1875953097672960:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 Request processed in 123us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048613.021633:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:1.0:1789048613.025311:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048613.025518:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097673088 00000100:00100000:2.0:1789048613.025530:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097673088 00000100:00100000:2.0:1789048613.025663:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:2.0:1789048613.025673:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:11087:x1875953097673088:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1789048613.027612:0:6498:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1894us 00000100:00080000:0.0:1789048613.028702:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789048613.057671:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:11087:x1875953097673088:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 Request processed in 31979us (32351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048613.057686:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:1.0:1789048613.343912:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111401216:0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.344035:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048613.344097:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111401728:0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.344125:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048613.344154:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111402240:0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.344174:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048613.344202:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789048613.344208:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111400832:0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.344235:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048613.344263:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111401344:0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.344287:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048613.344305:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111401856:0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.344325:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048613.344370:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111402368:0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.344389:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048613.344415:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111401088:0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.344438:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048613.344456:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0795aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111401600:0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.344477:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048613.344495:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111402112:0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.344516:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048613.344533:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789048613.344537:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111400960:0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.344558:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048613.344573:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111401472:0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.344593:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048613.344608:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875953111401984:0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.344627:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048613.344653:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111401216 00000100:00100000:1.0:1789048613.344660:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111401216 00000100:00100000:1.0:1789048613.344704:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111401600 00000100:00100000:1.0:1789048613.344707:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111401600 00000100:00100000:1.0:1789048613.344728:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111402112 00000100:00100000:1.0:1789048613.344731:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111402112 00000100:00100000:1.0:1789048613.344742:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111400960 00000100:00100000:1.0:1789048613.344752:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111400960 00000100:00100000:1.0:1789048613.344765:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111401472 00000100:00100000:1.0:1789048613.344767:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111401472 00000100:00100000:1.0:1789048613.344780:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111401984 00000100:00100000:1.0:1789048613.344782:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111401984 00000100:00100000:1.0:1789048613.344799:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789048613.344807:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111401216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.344863:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111401216:12345-0@lo:400:kworker.0 Request processed in 56us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048613.344870:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789048613.344886:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789048613.344891:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111401600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.344920:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111401600:12345-0@lo:400:kworker.0 Request processed in 29us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048613.344927:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789048613.344937:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789048613.344942:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111402112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.344967:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111402112:12345-0@lo:400:kworker.0 Request processed in 24us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048613.344972:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789048613.344982:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789048613.344987:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111400960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.345010:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111400960:12345-0@lo:400:kworker.0 Request processed in 22us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048613.345015:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789048613.345038:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789048613.345045:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111401472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.345077:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111401472:12345-0@lo:400:kworker.0 Request processed in 33us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048613.345084:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789048613.345095:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789048613.345101:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875953111401984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.345123:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875953111401984:12345-0@lo:400:kworker.0 Request processed in 22us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048613.345129:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789048613.345152:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111401728 00000100:00100000:1.0:1789048613.345156:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111401728 00000100:00100000:1.0:1789048613.345179:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111402240 00000100:00100000:1.0:1789048613.345182:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111402240 00000100:00100000:1.0:1789048613.345193:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111401856 00000100:00100000:1.0:1789048613.345196:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111401856 00000100:00100000:1.0:1789048613.345209:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111402368 00000100:00100000:1.0:1789048613.345213:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111402368 00000100:00100000:1.0:1789048613.345234:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789048613.345236:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111402496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048613.345242:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111401728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.345284:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111401728:12345-0@lo:400:kworker.0 Request processed in 43us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048613.345291:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048613.345296:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789048613.345310:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789048613.345317:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111402240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.345368:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111402240:12345-0@lo:400:kworker.0 Request processed in 52us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048613.345370:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111402496 00000100:00100000:3.0:1789048613.345377:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111402496 00000100:00100000:1.0:1789048613.345377:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789048613.345392:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789048613.345407:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111401856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048613.345414:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789048613.345423:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111402496:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048613.345438:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111401856:12345-0@lo:400:kworker.0 Request processed in 32us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048613.345446:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00002000:00000024:3.0:1789048613.345448:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048613.345461:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789048613.345469:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111402368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048613.345495:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111402496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048613.345502:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789048613.345507:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111402368:12345-0@lo:400:kworker.0 Request processed in 38us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048613.345515:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:3.0:1789048613.345544:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb9c700 x1875953111402496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048629 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048613.345545:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111401344 00000100:00100000:1.0:1789048613.345549:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111401344 00000100:00100000:3.0:1789048613.345568:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111402496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048613.345576:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111401088 00000100:00100000:1.0:1789048613.345580:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111401088 00000100:00100000:3.0:1789048613.345598:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789048613.345614:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111401344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048613.345643:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111401344:12345-0@lo:400:kworker.0 Request processed in 39us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048613.345878:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789048613.345889:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111401088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048613.345891:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111400832 00000100:00100000:0.0:1789048613.345898:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111400832 00000100:00100000:1.0:1789048613.345928:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111401088:12345-0@lo:400:kworker.0 Request processed in 42us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048613.345934:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1789048613.345939:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789048613.345946:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111400832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048613.345989:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111400832:12345-0@lo:400:kworker.0 Request processed in 47us (1752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048613.345995:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1789048613.346003:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111400960:0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.346015:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111401472:0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.346042:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875953111401984:0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.346055:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111401088:0@lo:400:kworker.0 00000100:00080000:0.0:1789048613.346057:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789048613.346064:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789048613.346067:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789048613.346069:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0795aa00 x1875953111401600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789048613.346070:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789048613.346094:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0795aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111401600:0@lo:400:kworker.0 00010000:00080000:1.0:1789048613.346107:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080a2d80 x1875953111402112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048613.346116:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111402112:0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.346216:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111400832:0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.346228:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111401344:0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.346238:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111401856:0@lo:400:kworker.0 00010000:00080000:1.0:1789048613.346248:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080a1c00 x1875953111402368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048613.346256:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111402368:0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.346273:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111401216:0@lo:400:kworker.0 00000100:00100000:1.0:1789048613.346283:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111401728:0@lo:400:kworker.0 00010000:00080000:1.0:1789048613.346292:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080a3480 x1875953111402240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048613.346300:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111402240:0@lo:400:kworker.0 00000100:00100000:0.0:1789048613.349226:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111402624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789048613.349297:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048613.349374:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111402624 00000100:00100000:0.0:1789048613.349383:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111402624 00000100:00100000:0.0:1789048613.349434:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789048613.349444:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111402624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789048613.349469:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048613.349520:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111402624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048613.349527:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:0.0:1789048613.349589:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fb2e300 x1875953111402624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048629 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048613.349607:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111402624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048613.350214:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000040:00080000:2.0:1789048613.534950:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789048613.538490:0:13781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789048613.853617:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048613.858735:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111402752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048613.858805:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048613.859237:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111402752 00000100:00100000:3.0:1789048613.859246:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111402752 00000100:00100000:3.0:1789048613.859298:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789048613.859308:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111402752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789048613.859376:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789048613.861617:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111402752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2299us (2800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048613.861631:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789048613.866593:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111402752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048614.367688:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789048614.367716:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b082ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111402880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789048614.367788:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048614.368070:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111402880 00000100:00100000:3.0:1789048614.368077:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111402880 00000100:00100000:3.0:1789048614.368127:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789048614.368138:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111402880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789048614.368167:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048614.368215:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111402880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048614.368223:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789048614.368272:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b082ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111402880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789048614.372567:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789048614.372591:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111403008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048614.372674:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048614.378567:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111403008 00000100:00100000:0.0:1789048614.378584:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111403008 00000100:00100000:0.0:1789048614.378699:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789048614.378711:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111403008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789048614.378739:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048614.378826:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111403008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (6152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048614.378833:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789048614.378934:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111403008:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789048614.877794:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048615.293049:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048615.293106:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097673216 00000100:00100000:1.0:1789048615.293116:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097673216 00000100:00100000:1.0:1789048615.293173:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:1.0:1789048615.293184:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:11129:x1875953097673216:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789048615.293205:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048615.293229:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c0877613b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b296fb expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293296:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776142 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293310:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776142 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293323:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776142 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293362:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c08776149 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293370:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c08776149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293377:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c08776149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293419:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776142 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293427:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776142 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293445:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776142 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293451:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048615.293455:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776142 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293463:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776142 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293476:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c09e4f900) 00010000:00010000:1.0:1789048615.293479:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048615.293484:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776142 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293490:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776142 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293502:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c08776149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293508:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c08776149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293514:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c08776149 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293519:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048615.293522:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c08776149 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293538:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c08776149 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293546:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff959c3ef1f900) 00010000:00010000:1.0:1789048615.293548:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048615.293551:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c08776149 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293557:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c08776149 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293589:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c0877613b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296fb expref: 10 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.293600:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c09e4f900) 00010000:00010000:1.0:1789048615.293603:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048615.293606:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c0877613b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296fb expref: 10 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.294108:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1c00, rc 0) 00000100:00100000:1.0:1789048615.294174:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:11129:x1875953097673216:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 991us (1135us total) trans 0 rc 301/301 00000100:00100000:1.0:1789048615.294183:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00080000:1.0:1789048615.294212:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048615.306786:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048615.307576:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097673472 00000100:00100000:2.0:1789048615.307588:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097673472 00000100:00100000:2.0:1789048615.307877:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:2.0:1789048615.307888:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:11129:x1875953097673472:12345-192.168.202.16@tcp:36:lfs.0 00010000:00010000:2.0:1789048615.307943:0:8649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048615.307972:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c087760f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296e6 expref: 9 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.307990:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c09e4f900) 00010000:00010000:2.0:1789048615.308002:0:8649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789048615.309245:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776150 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.309264:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776150 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.309277:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776150 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.309290:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776157 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.309296:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776157 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.309302:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776157 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.309936:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837e00/0x133f221c0877615e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.309948:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837e00/0x133f221c0877615e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.309966:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837e00/0x133f221c0877615e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789048615.309984:0:8649:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000f23fb3a3 reply state 00000000a53e57bf transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837e00/0x133f221c0877615e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.309994:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837e00/0x133f221c0877615e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.310002:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:2.0:1789048615.310014:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789048615.310019:0:8649:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789048615.310025:0:8649:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789048615.310032:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776150 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.310040:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776150 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.310047:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776150 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.310123:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048615.310128:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776150 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.310136:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776150 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.310146:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c02b11400) 00010000:00010000:2.0:1789048615.310148:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048615.310159:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776150 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.310165:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776150 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789048615.310182:0:8649:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000f23fb3a3 reply state 00000000a53e57bf transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776157 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.310191:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776157 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.310198:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff959c02b11600) 00010000:00010000:2.0:1789048615.310200:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789048615.310202:0:8649:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789048615.310322:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+10:11129:x1875953097673472:12345-192.168.202.16@tcp:36:lfs.0 Request processed in 2432us (3542us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789048615.310691:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:0.0:1789048615.390027:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789048615.390049:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111403136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048615.390177:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048615.390282:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111403136 00000100:00100000:3.0:1789048615.390291:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111403136 00000100:00100000:3.0:1789048615.390355:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789048615.390364:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111403136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789048615.390446:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789048615.390488:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111403136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048615.390494:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789048615.390885:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111403136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048615.413796:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048615.414030:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097673600 00000100:00100000:2.0:1789048615.414309:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097673600 00000100:00100000:2.0:1789048615.414499:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:2.0:1789048615.414508:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+10:11137:x1875953097673600:12345-192.168.202.16@tcp:101:lctl.0 00010000:00010000:2.0:1789048615.414531:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048615.414556:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776165 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29702 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.414617:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c0877616c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.414628:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c0877616c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.414651:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c0877616c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048615.414687:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789048615.414689:0:6498:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789048615.414723:0:6498:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c0877616c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.414742:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776165 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29702 expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.414757:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c0877616c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29702 expref: 11 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.414763:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c02b11400) 00010000:00010000:2.0:1789048615.414765:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789048615.414767:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02836600, rc 0) 00000100:00100000:2.0:1789048615.414818:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+11:11137:x1875953097673600:12345-192.168.202.16@tcp:101:lctl.0 Request processed in 312us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048615.414823:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:2.0:1789048615.492093:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048615.494776:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097673728 00000100:00100000:1.0:1789048615.494793:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097673728 00000100:00100000:1.0:1789048615.494871:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:1.0:1789048615.495721:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+11:11143:x1875953097673728:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1789048615.495749:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048615.495774:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776173 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29709 expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.495841:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c0877617a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.495855:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c0877617a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.495867:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c0877617a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.495878:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776181 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.495885:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776181 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.495906:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776181 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.495997:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1600/0x133f221c08776188 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.496025:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1600/0x133f221c08776188 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.496034:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1600/0x133f221c08776188 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048615.496085:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789048615.496089:0:12131:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789048615.496129:0:12131:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1600/0x133f221c08776188 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.496142:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c0877617a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.496149:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c0877617a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.496155:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c0877617a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.496160:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048615.496164:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c0877617a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.496171:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c0877617a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.496184:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c02b11400) 00010000:00010000:1.0:1789048615.496187:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048615.496191:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c0877617a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.496197:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c0877617a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.496212:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776181 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.496228:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776181 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.496234:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776181 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.496239:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048615.496242:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776181 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.496249:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776181 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.496256:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff959c02b11600) 00010000:00010000:1.0:1789048615.496259:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048615.496262:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776181 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.496267:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776181 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.496295:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776173 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29709 expref: 13 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.496308:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1600/0x133f221c08776188 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29709 expref: 12 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.496314:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:1.0:1789048615.496316:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789048615.496325:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1600, rc 0) 00000100:00100000:1.0:1789048615.496457:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+12:11143:x1875953097673728:12345-192.168.202.16@tcp:101:bash.0 Request processed in 1565us (4373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048615.496466:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:2.0:1789048615.503475:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048615.503656:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097673984 00000100:00100000:3.0:1789048615.503668:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097673984 00000100:00100000:3.0:1789048615.503730:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:3.0:1789048615.503740:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+12:11143:x1875953097673984:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1789048615.503762:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048615.503785:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c0877618f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29710 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.503893:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776196 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.503918:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776196 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.503931:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776196 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.503948:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c0877619d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.503955:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c0877619d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.503962:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c0877619d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789048615.504795:0:6497:0:(osp_object.c:1667:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789048615.504943:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087761a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.504956:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087761a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.504965:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087761a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.504996:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776196 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.505015:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776196 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.505023:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776196 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.505036:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3ca00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048615.505040:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776196 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.505049:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776196 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.506177:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:3.0:1789048615.506181:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048615.506188:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776196 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.506195:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776196 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789048615.506213:0:6497:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000fc3a83f0 reply state 00000000e4d6278c transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c0877619d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.506223:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c0877619d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.506229:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c14162400) 00010000:00010000:3.0:1789048615.506232:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789048615.506235:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789048615.506279:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c0877618f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29710 expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.506293:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087761a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29710 expref: 14 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.506316:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c14162600) 00010000:00010000:3.0:1789048615.506319:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789048615.506321:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3c800, rc 0) 00000100:00100000:2.0:1789048615.508213:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+15:11143:x1875953097673984:12345-192.168.202.16@tcp:101:bash.0 Request processed in 4465us (4737us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789048615.508227:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:2.0:1789048615.515143:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048615.516385:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097674112 00000100:00100000:1.0:1789048615.516397:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097674112 00000100:00100000:1.0:1789048615.516460:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:1.0:1789048615.516469:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2390:x1875953097674112:12345-192.168.202.16@tcp:8:bash.0 00010000:00080000:1.0:1789048615.516505:0:8413:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp t0 exp 0000000000000000 cur 370 last 0 00000020:00000080:1.0:1789048615.516537:0:8413:0:(genops.c:1384:class_connect()) connect: client 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b, cookie 0x133f221c087761b2 00002000:00100000:1.0:1789048615.516550:0:8413:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b/ffff959c3fb90000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789048615.516568:0:8413:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789048615.516642:0:8413:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789048615.516675:0:8413:0:(import.c:65:import_set_state_nolock()) ffff959c208a7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789048615.516746:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2390:x1875953097674112:12345-192.168.202.16@tcp:8:bash.0 Request processed in 276us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048615.516754:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:1.0:1789048615.529449:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048615.529613:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097674240 00000100:00100000:2.0:1789048615.529635:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097674240 00000100:00100000:2.0:1789048615.529714:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:2.0:1789048615.529725:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:0:x1875953097674240:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789048615.529745:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048615.529769:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd126ffe/0x133f221c087761b9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29717 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789048615.529798:0:8414:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789048615.529818:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=370s v=(0 0) 00010000:00010000:2.0:1789048615.529823:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048615.529833:0:8414:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd126ffe/0x133f221c087761b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29717 expref: 7 pid: 8414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.529853:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd126ffe/0x133f221c087761b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29717 expref: 7 pid: 8414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.529868:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02837800, rc 0) 00000100:00100000:2.0:1789048615.529953:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:0:x1875953097674240:12345-192.168.202.16@tcp:101:bash.0 Request processed in 230us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048615.529960:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00080000:1.0:1789048615.530077:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789048615.540213:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048615.540415:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097674368 00000100:00100000:1.0:1789048615.540425:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097674368 00000100:00100000:1.0:1789048615.540493:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:1.0:1789048615.540504:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:11143:x1875953097674368:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1789048615.540524:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048615.540547:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087761c0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2971e expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.540597:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd126ffe/0x133f221c087761b9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29717 expref: 8 pid: 8414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.540608:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048615.540612:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048615.540617:0:8413:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087761c0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2971e expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.540649:0:8413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd126ffe/0x133f221c087761b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29717 expref: 8 pid: 8414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.540663:0:8413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd126ffe/0x133f221c087761b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29717 expref: 8 pid: 8414 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048615.540678:0:8413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1875953111403264:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789048615.541136:0:8413:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3e180 going to sleep for 11 seconds 00000100:00100000:1.0:1789048615.553874:0:8413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1875953111403264:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789048615.553919:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087761c0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b2971e expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.553942:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0800, rc 0) 00000100:00100000:1.0:1789048615.554023:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:11143:x1875953097674368:12345-192.168.202.16@tcp:101:bash.0 Request processed in 13521us (13821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048615.554031:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:2.0:1789048615.555771:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048615.555829:0:13167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097674496 00000100:00100000:3.0:1789048615.555839:0:13167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097674496 00010000:00010000:3.0:1789048615.555883:0:13167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd126ffe/0x133f221c087761b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29717 expref: 8 pid: 8414 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048615.555924:0:13167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:3.0:1789048615.555933:0:13167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04cab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2393:x1875953097674496:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048615.555949:0:13167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048615.555971:0:13167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd126ffe/0x133f221c087761b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29717 expref: 8 pid: 8414 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.555981:0:13167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd126ffe/0x133f221c087761b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29717 expref: 8 pid: 8414 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.556000:0:13167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd126ffe/0x133f221c087761b9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29717 expref: 8 pid: 8414 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.556030:0:13167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048615.556035:0:13167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048615.556055:0:13167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087761c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b2971e expref: 7 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.556085:0:13167:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087761c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b2971e expref: 7 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.556127:0:13167:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087761c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b2971e expref: 7 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048615.556141:0:13167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:13167:1875953111403392:192.168.202.16@tcp:105: 00000100:00100000:3.0:1789048615.556206:0:13167:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c031983c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048615.558108:0:13167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:13167:1875953111403392:192.168.202.16@tcp:105: 00010000:00010000:0.0:1789048615.558131:0:13167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048615.558189:0:13167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04cab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2393:x1875953097674496:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2255us (2430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048615.558208:0:13167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:2.0:1789048615.564517:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048615.564804:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097674752 00000100:00100000:0.0:1789048615.564815:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097674752 00000100:00100000:0.0:1789048615.564885:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:0.0:1789048615.564897:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+15:11143:x1875953097674752:12345-192.168.202.16@tcp:35:bash.0 00000001:00080000:0.0:1789048615.565124:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967314 00000100:00100000:0.0:1789048615.565240:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+17:11143:x1875953097674752:12345-192.168.202.16@tcp:35:bash.0 Request processed in 345us (742us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789048615.565264:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000020:00080000:0.0:1789048615.565269:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789048615.748895:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048615.749054:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097675008 00000100:00100000:2.0:1789048615.749064:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097675008 00000100:00100000:2.0:1789048615.749128:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:2.0:1789048615.749138:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+17:11153:x1875953097675008:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048615.749176:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048615.749197:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c087761c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29725 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048615.749293:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789048615.749431:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c087761c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29725 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.749445:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c02b11400) 00010000:00010000:2.0:1789048615.749449:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789048615.749454:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c087761c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29725 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.749466:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb0200, rc 0) 00000100:00100000:2.0:1789048615.749528:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+18:11153:x1875953097675008:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 391us (642us total) trans 4294967316 rc 301/301 00000100:00100000:2.0:1789048615.749537:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:2.0:1789048615.759290:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048615.759506:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097675264 00000100:00100000:0.0:1789048615.759516:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097675264 00000100:00100000:0.0:1789048615.759579:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:0.0:1789048615.759589:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+18:11153:x1875953097675264:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:0.0:1789048615.759812:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+19:11153:x1875953097675264:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 224us (531us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789048615.759820:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:3.0:1789048615.886239:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048615.886384:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097675392 00000100:00100000:1.0:1789048615.886395:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097675392 00000100:00100000:1.0:1789048615.886466:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:1.0:1789048615.886476:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+19:11159:x1875953097675392:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789048615.886502:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048615.886524:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c087761d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2972c expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.886598:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087761dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.886613:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087761dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.886625:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087761dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048615.886666:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789048615.886670:0:12131:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789048615.886693:0:12131:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087761dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.886720:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c087761d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2972c expref: 21 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.886740:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087761dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2972c expref: 20 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.886749:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:1.0:1789048615.886766:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789048615.886770:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0000, rc 0) 00000100:00100000:1.0:1789048615.886837:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:11159:x1875953097675392:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 362us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048615.886843:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:2.0:1789048615.900458:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048615.900885:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097675648 00000100:00100000:1.0:1789048615.900895:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097675648 00000100:00100000:1.0:1789048615.900957:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:1.0:1789048615.900967:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:11159:x1875953097675648:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789048615.900989:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048615.901020:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c087761e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29733 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048615.901499:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048615.903786:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087761ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.903809:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087761ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.903822:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087761ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048615.903835:0:6497:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789048615.903965:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c087761e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29733 expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.903987:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087761ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29733 expref: 22 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.904028:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c14162600) 00010000:00010000:1.0:1789048615.904032:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789048615.904035:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1200, rc 0) 00000100:00100000:1.0:1789048615.906858:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+22:11159:x1875953097675648:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 5882us (6399us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789048615.906870:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:3.0:1789048615.911289:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048615.911415:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048615.911477:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097676032 00000100:00100000:0.0:1789048615.911485:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097676032 00000100:00100000:0.0:1789048615.911554:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:0.0:1789048615.911563:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+22:2391:x1875953097676032:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048615.911578:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048615.911606:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087761ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29733 expref: 22 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048615.911624:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c14162600) 00010000:00010000:0.0:1789048615.911629:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048615.911686:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+21:2391:x1875953097676032:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 124us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048615.911693:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:1.0:1789048615.916241:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097675904 00000100:00100000:1.0:1789048615.916258:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097675904 00000100:00100000:0.0:1789048615.920846:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:0.0:1789048615.920863:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+21:11159:x1875953097675904:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789048615.920887:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048615.920921:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087761f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2973a expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048615.921062:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087761ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048615.921077:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087761ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048615.921090:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087761ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048615.921105:0:8649:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789048615.921206:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087761f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2973a expref: 24 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048615.921224:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087761ff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2973a expref: 23 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048615.921232:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c14162600) 00010000:00010000:0.0:1789048615.921234:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789048615.921238:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38800, rc 0) 00000100:00100000:0.0:1789048615.921623:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+23:11159:x1875953097675904:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 762us (10341us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1789048615.921631:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:3.0:1789048615.931991:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048615.932287:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097676160 00000100:00100000:2.0:1789048615.932297:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097676160 00000100:00100000:2.0:1789048615.932732:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:2.0:1789048615.932744:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2394:x1875953097676160:12345-192.168.202.16@tcp:1:lfs.0 00010000:00010000:2.0:1789048615.932786:0:8414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002719e709/0x133f221c0877620d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.932806:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087761c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b2971e expref: 7 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.932829:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048615.932834:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789048615.932839:0:8414:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002719e709/0x133f221c0877620d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.932876:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087761c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0xd796648991b2971e expref: 7 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.932891:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087761c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b2971e expref: 7 pid: 8413 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048615.932906:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c04ca9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1875953111403520:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789048615.933024:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b08113540 going to sleep for 11 seconds 00000100:00100000:1.0:1789048615.936816:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c04ca9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1875953111403520:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789048615.936848:0:8414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002719e709/0x133f221c0877620d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048615.938633:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048615.938889:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097676288 00000100:00100000:2.0:1789048615.938900:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097676288 00002000:00100000:2.0:1789048615.938946:0:8417:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff959c3fb9ed80 x1875953097676288/t0(0) o4->85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp:626/0 lens 504/0 e 0 to 0 dl 1789048626 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789048615.938958:0:8417:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959c3fb9ed80 with x1875953097676288 ext(0->12) 00010000:00010000:2.0:1789048615.938968:0:8417:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087761c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b2971e expref: 8 pid: 8413 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.938985:0:8417:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087761c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b2971e expref: 8 pid: 8413 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789048615.938993:0:8417:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff959c3fb9ed80 00000100:00100000:2.0:1789048615.939044:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:2.0:1789048615.939063:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2393:x1875953097676288:12345-192.168.202.16@tcp:4:lfs.0 00000001:00100000:1.0:1789048615.942629:0:9492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 00000100:00100000:2.0:1789048615.943811:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:2393:x1875953097676288:12345-192.168.202.16@tcp:4:lfs.0 Request processed in 4741us (5177us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789048615.943824:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00002000:00100000:2.0:1789048615.943836:0:8417:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff959c3fb9ed80 x1875953097676288/t4294967300(0) o4->85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp:626/0 lens 504/448 e 0 to 0 dl 1789048626 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789048615.943847:0:8417:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959c3fb9ed80 with x1875953097676288 ext(0->12) 00010000:00010000:2.0:1789048615.943857:0:8417:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087761c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b2971e expref: 9 pid: 8413 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.943875:0:8417:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087761c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b2971e expref: 9 pid: 8413 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789048615.943883:0:8417:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff959c3fb9ed80 00000100:00100000:2.0:1789048615.948136:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048615.948214:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097676416 00000100:00100000:1.0:1789048615.948224:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097676416 00010000:00010000:1.0:1789048615.948267:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087761c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b2971e expref: 9 pid: 8413 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048615.948317:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:1.0:1789048615.948327:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:2393:x1875953097676416:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048615.948392:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789048615.948412:0:6483:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789048615.948416:0:6483:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789048616172765024 00002000:00010000:1.0:1789048615.948418:0:6483:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789048616544184634 00002000:00010000:1.0:1789048615.948420:0:6483:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789048616172765024 00002000:00010000:1.0:1789048615.948437:0:6483:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789048615.948445:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087761c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b2971e expref: 9 pid: 8413 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.948460:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087761c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b2971e expref: 9 pid: 8413 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.948485:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087761c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b2971e expref: 9 pid: 8413 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.948503:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789048615.948507:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789048615.948514:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002719e709/0x133f221c0877620d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.948525:0:6483:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002719e709/0x133f221c0877620d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048615.948560:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789048615.948604:0:8414:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002719e709/0x133f221c0877620d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048615.948614:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2393:x1875953097676416:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 286us (487us total) trans 0 rc 0/0 00010000:00010000:2.0:1789048615.948619:0:8414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002719e709/0x133f221c0877620d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048615.948628:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 54 00010000:00010000:2.0:1789048615.948649:0:8414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002719e709/0x133f221c0877620d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.948658:0:8414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002719e709/0x133f221c0877620d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.948673:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002719e709/0x133f221c0877620d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.948680:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048615.948691:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002719e709/0x133f221c0877620d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.948700:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002719e709/0x133f221c0877620d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.948713:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002719e709/0x133f221c0877620d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.948721:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002719e709/0x133f221c0877620d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048615.948771:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2394:x1875953097676160:12345-192.168.202.16@tcp:1:lfs.0 Request processed in 16030us (16789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048615.948779:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:2.0:1789048615.958189:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048615.958303:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097676672 00000100:00100000:0.0:1789048615.958313:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097676672 00000100:00100000:0.0:1789048615.958406:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1789048615.958416:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+23:11159:x1875953097676672:12345-192.168.202.16@tcp:35:lfs.0 00000004:00010000:0.0:1789048615.958497:0:6500:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087761ff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2973a expref: 23 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789048615.958730:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1789048615.958758:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:0.0:1789048615.959057:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00010000:00010000:0.0:1789048615.959093:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776214 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048615.959107:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087761a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29710 expref: 27 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048615.959116:0:6500:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776214 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048615.959160:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087761a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29710 expref: 27 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048615.959175:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087761a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29710 expref: 27 pid: 6497 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048615.959189:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c064bb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6500:1875953111403648:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789048615.959278:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c034fd900 going to sleep for 11 seconds 00000100:00100000:3.0:1789048615.972501:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048615.972913:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c064bb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6500:1875953111403648:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048615.972944:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776214 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048615.975513:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097676800 00000100:00100000:2.0:1789048615.975532:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097676800 00010000:00010000:2.0:1789048615.975590:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087761a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29710 expref: 28 pid: 6497 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048615.975683:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:2.0:1789048615.975693:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+28:2393:x1875953097676800:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048615.975708:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048615.975715:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087761a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29710 expref: 28 pid: 6497 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.975727:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087761a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29710 expref: 28 pid: 6497 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.975749:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087761a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29710 expref: 28 pid: 6497 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.975768:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c14162600) 00010000:00010000:2.0:1789048615.975775:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776214 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.975786:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776214 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.975794:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776214 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.975819:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789048615.975835:0:6500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776214 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048615.975853:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776214 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048615.975892:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+27:2393:x1875953097676800:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 199us (3401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048615.975899:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 55 00000001:00080000:0.0:1789048615.975960:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000001:00080000:0.0:1789048615.976107:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1789048615.976190:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c064bb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1875953111403776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789048615.976243:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048615.976566:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef21600 going to sleep for 11 seconds 00000100:00100000:1.0:1789048615.977325:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111403776 00000100:00100000:1.0:1789048615.977452:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111403776 00000100:00100000:1.0:1789048615.977549:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789048615.977558:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6500:x1875953111403776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789048615.977703:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6500:x1875953111403776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 145us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048615.977722:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789048615.977895:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c064bb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1875953111403776:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789048615.978105:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00000100:00100000:2.0:1789048615.978173:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c04caaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1875953111403904:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789048615.978212:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048615.978244:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b08113cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048615.978538:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111403904 00000100:00100000:3.0:1789048615.978544:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111403904 00000100:00100000:3.0:1789048615.978591:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789048615.978599:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6500:x1875953111403904:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789048615.978951:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6500:x1875953111403904:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 352us (737us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789048615.978958:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789048615.979064:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c04caaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1875953111403904:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789048615.979111:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1789048615.979148:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776214 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.979158:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776214 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.979166:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776214 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.979172:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048615.979176:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776214 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.979183:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776214 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.979198:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c14162600) 00010000:00010000:2.0:1789048615.979201:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789048615.979206:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776214 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.979213:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776214 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789048615.979308:0:6500:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789048615.979424:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789048615.979437:0:6500:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370733103481ns, next at 371733100436ns, rc = 0 00000001:00080000:2.0:1789048615.979443:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967327 00010000:00010000:2.0:1789048615.979465:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c14162600) 00010000:00010000:2.0:1789048615.979468:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789048615.979475:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087761ff lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2973a expref: 31 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048615.979568:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+30:11159:x1875953097676672:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 21153us (21390us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789048615.979576:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000020:00080000:2.0:1789048615.979579:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789048615.983488:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048615.983597:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097676928 00000100:00100000:2.0:1789048615.983607:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097676928 00000100:00100000:2.0:1789048615.983668:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:2.0:1789048615.983678:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+30:11159:x1875953097676928:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048615.983701:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048615.983725:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c0877621b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29741 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.983783:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c0877621b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29741 expref: 31 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.983799:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c0877621b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29741 expref: 31 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048615.983817:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:2.0:1789048615.983820:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789048615.983837:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb1200, rc 0) 00000100:00100000:2.0:1789048615.983900:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+31:11159:x1875953097676928:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 223us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048615.983907:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00080000:0.0:1789048615.984079:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789048615.988318:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048615.988509:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097677184 00000100:00100000:1.0:1789048615.988519:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097677184 00000100:00100000:1.0:1789048615.988574:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:1.0:1789048615.988585:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2ad38050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+31:11159:x1875953097677184:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1789048615.988862:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2ad38050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+32:11159:x1875953097677184:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 278us (553us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1789048615.988870:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:3.0:1789048616.071962:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048616.072092:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097677440 00000100:00100000:1.0:1789048616.072104:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097677440 00000100:00100000:1.0:1789048616.072166:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:1.0:1789048616.072176:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+32:11169:x1875953097677440:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789048616.072200:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048616.072221:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776222 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29748 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048616.072320:0:6497:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789048616.072459:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776222 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29748 expref: 34 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048616.072472:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c02b11400) 00010000:00010000:1.0:1789048616.072475:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789048616.072481:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776222 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29748 expref: 34 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048616.072495:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1000, rc 0) 00000100:00100000:1.0:1789048616.072561:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+33:11169:x1875953097677440:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 387us (609us total) trans 4294967330 rc 301/301 00000100:00100000:1.0:1789048616.072569:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:1.0:1789048616.080264:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048616.080375:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097677568 00000100:00100000:0.0:1789048616.080386:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097677568 00000100:00100000:0.0:1789048616.080445:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:0.0:1789048616.080454:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+33:11169:x1875953097677568:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:0.0:1789048616.080521:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776230 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080539:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776230 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080550:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776230 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080561:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776237 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080568:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776237 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080574:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776237 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080657:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877623e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080666:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877623e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080673:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877623e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789048616.080716:0:8649:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877623e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080727:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776230 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080735:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776230 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080742:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776230 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080748:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048616.080752:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776230 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080759:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776230 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080770:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:0.0:1789048616.080773:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048616.080777:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776230 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080789:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776230 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080802:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776237 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080808:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776237 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080814:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776237 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080819:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048616.080822:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776237 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080828:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776237 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080835:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c14162400) 00010000:00010000:0.0:1789048616.080837:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048616.080839:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776237 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080845:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776237 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080852:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877623e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080858:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877623e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080868:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877623e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080873:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048616.080876:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877623e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080882:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877623e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080888:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:0.0:1789048616.080890:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048616.080892:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877623e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.080897:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877623e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048616.083720:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+33:11169:x1875953097677568:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 3253us (3453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048616.083736:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:3.0:1789048616.092597:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048616.092690:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097677824 00000100:00100000:1.0:1789048616.092699:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097677824 00000100:00100000:1.0:1789048616.092762:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:1.0:1789048616.092773:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+33:11169:x1875953097677824:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1789048616.093056:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+34:11169:x1875953097677824:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 278us (463us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1789048616.093065:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:0.0:1789048616.143774:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048616.146546:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097678080 00000100:00100000:1.0:1789048616.146560:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097678080 00000100:00100000:0.0:1789048616.146766:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:0.0:1789048616.146778:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+34:11172:x1875953097678080:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789048616.146803:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048616.146824:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c08776245 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2974f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.146917:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877624c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.146931:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877624c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.146943:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877624c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.146955:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776253 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.146963:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776253 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.147116:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776253 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.147298:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c0877625a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.147308:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c0877625a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.147316:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c0877625a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048616.147327:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789048616.147705:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877624c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.147715:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877624c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.147731:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877624c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.147737:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048616.147742:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877624c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.147750:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877624c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.147763:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:0.0:1789048616.147766:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048616.147771:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877624c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.147777:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877624c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.147791:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776253 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.147797:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776253 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.147803:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776253 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.147807:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048616.147810:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776253 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.147827:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776253 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.147836:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c14162400) 00010000:00010000:0.0:1789048616.147839:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048616.147842:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776253 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.147849:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776253 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.147890:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c08776245 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2974f expref: 37 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.147904:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c0877625a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2974f expref: 36 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.147913:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:0.0:1789048616.147915:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048616.147918:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38200, rc 0) 00000100:00100000:0.0:1789048616.148185:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+36:11172:x1875953097678080:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1408us (4419us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789048616.148194:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:3.0:1789048616.151910:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048616.152064:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097678208 00000100:00100000:2.0:1789048616.152074:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097678208 00000100:00100000:2.0:1789048616.152370:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:2.0:1789048616.152381:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+36:11172:x1875953097678208:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:2.0:1789048616.152471:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776268 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.152489:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.152500:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.152537:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.152542:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776268 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.152547:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776268 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.152551:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048616.152554:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776268 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.152558:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776268 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.152574:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:2.0:1789048616.152576:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789048616.152580:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776268 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.152584:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776268 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048616.152710:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+36:11172:x1875953097678208:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 331us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048616.152718:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:3.0:1789048616.158979:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048616.159777:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097678464 00000100:00100000:1.0:1789048616.159787:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097678464 00000100:00100000:1.0:1789048616.159839:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:1.0:1789048616.159846:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+36:11172:x1875953097678464:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1789048616.160071:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+37:11172:x1875953097678464:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 223us (1101us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789048616.160317:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:0.0:1789048616.552817:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048616.552920:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097678720 00000100:00100000:2.0:1789048616.552931:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097678720 00000100:00100000:2.0:1789048616.553006:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:2.0:1789048616.553016:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+37:11203:x1875953097678720:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:2.0:1789048616.553042:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048616.553072:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c0877626f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29756 expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.553183:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776276 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.553197:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776276 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.553210:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776276 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048616.553220:0:8649:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789048616.553657:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c0877626f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29756 expref: 40 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.553677:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776276 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29756 expref: 39 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.553686:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:2.0:1789048616.553689:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789048616.553693:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb1000, rc 0) 00000100:00100000:2.0:1789048616.553757:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+39:11203:x1875953097678720:12345-192.168.202.16@tcp:101:cat.0 Request processed in 742us (950us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1789048616.553762:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:3.0:1789048616.560674:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048616.560773:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097679104 00000100:00100000:2.0:1789048616.560783:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097679104 00000100:00100000:2.0:1789048616.560906:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:2.0:1789048616.560918:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+39:11203:x1875953097679104:12345-192.168.202.16@tcp:35:cat.0 00000100:00100000:2.0:1789048616.561206:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+40:11203:x1875953097679104:12345-192.168.202.16@tcp:35:cat.0 Request processed in 289us (540us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789048616.561213:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:3.0:1789048616.562725:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048616.564109:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097678848 00000100:00100000:0.0:1789048616.564122:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097678848 00000100:00100000:0.0:1789048616.564208:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:0.0:1789048616.564219:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+40:2393:x1875953097678848:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048616.564252:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048616.564280:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776276 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29756 expref: 40 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.564302:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:0.0:1789048616.564306:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048616.564405:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+39:2393:x1875953097678848:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 187us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048616.564412:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000040:00080000:1.0:1789048616.606130:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789048616.607865:0:13781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789048616.668470:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048616.668566:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097679360 00000100:00100000:2.0:1789048616.668574:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097679360 00000100:00100000:2.0:1789048616.668624:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:2.0:1789048616.668631:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+39:11209:x1875953097679360:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1789048616.668651:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048616.668653:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789048616.668683:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087761dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2972c expref: 39 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.668715:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:2.0:1789048616.668718:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789048616.668730:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776284 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2975d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.668832:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877628b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.668842:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c0877625a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2974f expref: 39 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.668847:0:6498:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877628b lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.668872:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c0877625a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2974f expref: 39 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.668882:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c0877625a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2974f expref: 39 pid: 6498 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048616.668891:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c04ca8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1875953111404032:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789048616.670307:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b081136c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048616.673864:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048616.674421:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097679488 00000100:00100000:0.0:1789048616.674430:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097679488 00010000:00010000:0.0:1789048616.674472:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c0877625a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2974f expref: 40 pid: 6498 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048616.674517:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:0.0:1789048616.674528:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+40:2393:x1875953097679488:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048616.674543:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048616.674550:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c0877625a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2974f expref: 40 pid: 6498 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.674565:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c0877625a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2974f expref: 40 pid: 6498 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.674587:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:0.0:1789048616.674593:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877628b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.674616:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877628b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.674625:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877628b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048616.674645:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048616.674699:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+40:2393:x1875953097679488:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 172us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048616.674707:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 56 00010000:00010000:2.0:1789048616.675639:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c0877625a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2974f expref: 39 pid: 6498 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048616.675660:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c04ca8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1875953111404032:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789048616.675697:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877628b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.675707:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877628b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.675713:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877628b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048616.675733:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789048616.675886:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776284 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2975d expref: 40 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.675903:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877628b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2975d expref: 39 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.675912:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:2.0:1789048616.675916:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789048616.675919:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb0000, rc 0) 00000100:00100000:2.0:1789048616.676170:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+39:11209:x1875953097679360:12345-192.168.202.16@tcp:101:dd.0 Request processed in 7537us (7708us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1789048616.676180:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:3.0:1789048616.680309:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048616.681209:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097679616 00000100:00100000:2.0:1789048616.681221:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097679616 00000100:00100000:2.0:1789048616.681368:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:2.0:1789048616.681380:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+39:11209:x1875953097679616:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1789048616.681404:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048616.681428:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776299 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29764 expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.681480:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087762a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.681496:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087762a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.681508:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087762a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.681624:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776299 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29764 expref: 41 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.681643:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087762a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29764 expref: 40 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.681652:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:2.0:1789048616.681654:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789048616.681658:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb1600, rc 0) 00000100:00100000:2.0:1789048616.681725:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+40:11209:x1875953097679616:12345-192.168.202.16@tcp:101:dd.0 Request processed in 347us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048616.681732:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:3.0:1789048616.686419:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048616.686484:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097679872 00000100:00100000:2.0:1789048616.686496:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097679872 00000100:00100000:2.0:1789048616.686561:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:2.0:1789048616.686571:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+40:11209:x1875953097679872:12345-192.168.202.16@tcp:36:dd.0 00010000:00010000:2.0:1789048616.686811:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c087762a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.686846:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c087762a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.686858:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c087762a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789048616.686904:0:8649:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1789048616.686926:0:8649:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000005563a9f0 reply state 000000000a29c2fb transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c087762a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.686938:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c087762a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048616.686945:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:2.0:1789048616.686947:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789048616.686951:0:8649:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789048616.687062:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+43:11209:x1875953097679872:12345-192.168.202.16@tcp:36:dd.0 Request processed in 490us (651us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789048616.687069:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 62 00000020:00080000:2.0:1789048616.687073:0:8649:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789048616.925669:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048617.029540:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048617.029583:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048617.029614:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048617.029644:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048617.029671:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097680256 00000100:00100000:2.0:1789048617.029680:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097680256 00000100:00100000:2.0:1789048617.029738:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097680128 00000100:00100000:1.0:1789048617.029738:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097680512 00000100:00100000:2.0:1789048617.029742:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097680128 00000100:00100000:1.0:1789048617.029742:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097680512 00000100:00100000:0.0:1789048617.029798:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097680000 00000100:00100000:0.0:1789048617.029803:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097680000 00000100:00100000:0.0:1789048617.029837:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 392 00000100:00100000:0.0:1789048617.029847:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2393:x1875953097680000:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048617.029917:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2393:x1875953097680000:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 71us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048617.029924:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 392 00000100:00080000:0.0:1789048617.029957:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789048617.029961:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789048617.030048:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 301 00000100:00100000:2.0:1789048617.030057:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097680256:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048617.030111:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097680256:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 56us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048617.030119:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 301 00000100:00100000:2.0:1789048617.030134:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 302 00000100:00100000:2.0:1789048617.030140:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+43:2393:x1875953097680128:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048617.030165:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+43:2393:x1875953097680128:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 25us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048617.030171:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 302 00000100:00100000:2.0:1789048617.030182:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 303 00000100:00100000:2.0:1789048617.030188:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097680512:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048617.030207:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097680512:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 20us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048617.030213:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 303 00000100:00100000:3.0:1789048617.030374:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048617.030440:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048617.033497:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097680640 00000100:00100000:1.0:1789048617.033516:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097680640 00000100:00100000:1.0:1789048617.033674:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 304 00000100:00100000:1.0:1789048617.033691:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097680640:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048617.033787:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097680640:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 100us (3346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048617.033795:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 304 00000100:00080000:1.0:1789048617.033944:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048617.044662:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097680384 00000100:00100000:3.0:1789048617.044676:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097680384 00000100:00100000:3.0:1789048617.044750:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 106 00000100:00100000:3.0:1789048617.044760:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2393:x1875953097680384:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048617.044831:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2393:x1875953097680384:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 73us (14457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048617.044838:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 106 00000100:00080000:1.0:1789048617.045551:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789048617.148459:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048617.148525:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097680768 00000100:00100000:3.0:1789048617.148536:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097680768 00000100:00100000:3.0:1789048617.148622:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:3.0:1789048617.148633:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+43:11224:x1875953097680768:12345-192.168.202.16@tcp:101:stat.0 00010000:00010000:3.0:1789048617.148655:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048617.148677:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c087762ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2976b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.148747:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c087762b5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.148783:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c087762b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.148795:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c087762b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.148807:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087762bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.148814:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087762bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.148821:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087762bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.148899:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.148909:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877628b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2975d expref: 44 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.148917:0:6497:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762c3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.148964:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877628b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2975d expref: 44 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.148978:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877628b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2975d expref: 44 pid: 6498 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048617.149013:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875953111404160:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048617.149187:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c03198180 going to sleep for 11 seconds 00000100:00100000:3.0:1789048617.152798:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048617.152842:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875953111404160:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789048617.152872:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048617.152945:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097681024 00000100:00100000:0.0:1789048617.152954:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097681024 00000100:00100000:0.0:1789048617.153033:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:0.0:1789048617.153043:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+45:6167:x1875953097681024:12345-192.168.202.16@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789048617.153540:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+46:6167:x1875953097681024:12345-192.168.202.16@tcp:35:ldlm_bl.0 Request processed in 497us (755us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1789048617.153548:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:0.0:1789048617.159146:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048617.159413:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097681152 00000100:00100000:1.0:1789048617.159423:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097681152 00010000:00010000:1.0:1789048617.159472:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877628b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2975d expref: 46 pid: 6498 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048617.159561:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:1.0:1789048617.159572:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2aecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+46:2393:x1875953097681152:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048617.159590:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048617.159597:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877628b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2975d expref: 46 pid: 6498 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048617.159611:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877628b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2975d expref: 46 pid: 6498 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048617.159634:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877628b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2975d expref: 46 pid: 6498 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048617.159669:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:1.0:1789048617.159675:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048617.159686:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048617.159695:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762c3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048617.159736:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048617.159798:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2aecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+45:2393:x1875953097681152:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 228us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048617.159806:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 57 00010000:00010000:2.0:1789048617.161048:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.161064:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048617.161131:0:6497:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789048617.161135:0:6497:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789048617.161182:0:6497:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.161200:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.161230:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c087762b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.161237:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c087762b5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.161245:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c087762b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.161250:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048617.161254:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c087762b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.161262:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c087762b5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.161275:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:2.0:1789048617.161279:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048617.161284:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c087762b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.161289:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c087762b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.161307:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087762bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.161313:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087762bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.161318:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087762bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.161330:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048617.161402:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087762bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.161409:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087762bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.161418:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c14162400) 00010000:00010000:2.0:1789048617.161421:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048617.161424:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087762bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.161430:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087762bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.161468:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c087762ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2976b expref: 45 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.161485:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2976b expref: 44 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.161493:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:2.0:1789048617.161495:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789048617.161498:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3c800, rc 0) 00000100:00100000:2.0:1789048617.161561:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+44:11224:x1875953097680768:12345-192.168.202.16@tcp:101:stat.0 Request processed in 12929us (13117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048617.161570:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:0.0:1789048617.282149:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048617.282265:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097681408 00000100:00100000:1.0:1789048617.282276:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097681408 00000100:00100000:1.0:1789048617.282371:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:1.0:1789048617.282379:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+44:11230:x1875953097681408:12345-192.168.202.16@tcp:36:truncate.0 00010000:00010000:1.0:1789048617.282433:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048617.282461:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2976b expref: 44 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048617.282478:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:1.0:1789048617.282482:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789048617.282636:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087762ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048617.282649:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087762ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048617.282670:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087762ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789048617.282708:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967340 00000004:00010000:1.0:1789048617.282724:0:6498:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000ee410f0c reply state 00000000c99e513f transno 4294967341 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087762ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048617.282732:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087762ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048617.282736:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:1.0:1789048617.282738:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789048617.282740:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789048617.282838:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+46:11230:x1875953097681408:12345-192.168.202.16@tcp:36:truncate.0 Request processed in 460us (701us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1789048617.282844:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 64 00000020:00080000:1.0:1789048617.282849:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789048617.493420:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048617.493609:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097681536 00000100:00100000:3.0:1789048617.493620:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097681536 00000100:00100000:3.0:1789048617.493690:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:3.0:1789048617.493701:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+46:11244:x1875953097681536:12345-192.168.202.16@tcp:101:stat.0 00010000:00010000:3.0:1789048617.493726:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048617.493749:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c087762d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29772 expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.493826:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c087762d8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.493844:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c087762d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.493857:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c087762d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.493869:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087762df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.493876:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087762df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.493883:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087762df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.493995:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.494005:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.494013:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048617.494057:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1789048617.494061:0:12131:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789048617.494084:0:12131:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.494096:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.494104:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c087762d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.494109:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c087762d8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.494116:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c087762d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.494122:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3de00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048617.494127:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c087762d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.494133:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c087762d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.494151:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:3.0:1789048617.494153:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048617.494159:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c087762d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.494165:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c087762d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.494179:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087762df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.494184:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087762df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.494189:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087762df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.494194:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048617.494196:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087762df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.494202:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087762df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.494208:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c14162400) 00010000:00010000:3.0:1789048617.494210:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048617.494213:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087762df lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.494217:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087762df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.494251:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c087762d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29772 expref: 48 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.494264:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29772 expref: 47 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.494271:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:3.0:1789048617.494273:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789048617.494275:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3c800, rc 0) 00000100:00100000:3.0:1789048617.494494:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+47:11244:x1875953097681536:12345-192.168.202.16@tcp:101:stat.0 Request processed in 793us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048617.494501:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:0.0:1789048617.631289:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048617.631679:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097681792 00000100:00100000:2.0:1789048617.631706:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097681792 00000100:00100000:2.0:1789048617.631774:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:2.0:1789048617.631784:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+47:11254:x1875953097681792:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048617.631806:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048617.631829:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087762ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29779 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048617.631928:0:6497:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789048617.632037:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087762ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29779 expref: 49 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.632051:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c02b11400) 00010000:00010000:2.0:1789048617.632054:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789048617.632059:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087762ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29779 expref: 49 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.632074:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb0800, rc 0) 00000100:00100000:2.0:1789048617.632135:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+48:11254:x1875953097681792:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 351us (854us total) trans 4294967342 rc 301/301 00000100:00100000:2.0:1789048617.632142:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:1.0:1789048617.636413:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048617.636831:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097682048 00000100:00100000:2.0:1789048617.636843:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097682048 00000100:00100000:2.0:1789048617.636908:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:2.0:1789048617.636920:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+48:11254:x1875953097682048:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789048617.637180:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+49:11254:x1875953097682048:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 261us (778us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789048617.637188:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:0.0:1789048617.721650:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048617.721951:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097682304 00000100:00100000:3.0:1789048617.721961:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097682304 00000100:00100000:3.0:1789048617.722049:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:3.0:1789048617.722060:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+49:11260:x1875953097682304:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1789048617.722084:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048617.722106:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c087762fb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29780 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.722222:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776302 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.722237:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29772 expref: 50 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.722246:0:6499:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776302 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.722296:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29772 expref: 50 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.722309:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29772 expref: 50 pid: 12131 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048617.722369:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b613800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875953111404288:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048617.722495:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c031986c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048617.729177:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b613800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875953111404288:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048617.729212:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776302 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048617.734478:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048617.734560:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097682432 00000100:00100000:2.0:1789048617.734570:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097682432 00010000:00010000:2.0:1789048617.734615:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29772 expref: 51 pid: 12131 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048617.734663:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:2.0:1789048617.734673:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+51:2394:x1875953097682432:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048617.734688:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048617.734695:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29772 expref: 51 pid: 12131 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.734708:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29772 expref: 51 pid: 12131 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.734729:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087762e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29772 expref: 51 pid: 12131 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.734745:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:2.0:1789048617.734749:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776302 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.734758:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776302 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.734766:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776302 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.734796:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048617.734856:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+50:2394:x1875953097682432:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 184us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048617.734877:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 58 00010000:00010000:0.0:1789048617.734998:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776302 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048617.735009:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776302 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048617.735029:0:6499:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1789048617.735177:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c087762fb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29780 expref: 51 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048617.735194:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776302 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29780 expref: 50 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048617.735200:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:0.0:1789048617.735203:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789048617.735205:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3c400, rc 0) 00000100:00100000:0.0:1789048617.735246:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+50:11260:x1875953097682304:12345-192.168.202.16@tcp:101:bash.0 Request processed in 13188us (13608us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1789048617.735254:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:0.0:1789048617.738736:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048617.738916:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097682688 00000100:00100000:3.0:1789048617.738926:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097682688 00000100:00100000:3.0:1789048617.739017:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:3.0:1789048617.739029:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+50:11260:x1875953097682688:12345-192.168.202.16@tcp:36:bash.0 00010000:00010000:3.0:1789048617.739541:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776310 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.739560:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776310 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.739572:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776310 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789048617.739811:0:12131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967345 00000004:00010000:3.0:1789048617.739925:0:12131:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000da4bd249 reply state 0000000018103fd2 transno 4294967346 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776310 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.739939:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776310 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.739947:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:3.0:1789048617.739958:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789048617.739962:0:12131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789048617.740284:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+53:11260:x1875953097682688:12345-192.168.202.16@tcp:36:bash.0 Request processed in 1255us (1554us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789048617.740292:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 68 00000020:00080000:3.0:1789048617.740298:0:12131:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789048617.751997:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048617.753744:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097682816 00000100:00100000:1.0:1789048617.753759:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097682816 00000100:00100000:1.0:1789048617.753922:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:1.0:1789048617.753934:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+53:11260:x1875953097682816:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1789048617.753959:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048617.753995:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08776317 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29787 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048617.754098:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877631e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048617.754132:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776302 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29780 expref: 54 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048617.754140:0:6498:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877631e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048617.754174:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776302 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29780 expref: 54 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048617.754187:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776302 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29780 expref: 54 pid: 6499 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048617.754201:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b082ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1875953111404416:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789048617.754298:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789048617.763306:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048617.764207:0:13167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097682944 00000100:00100000:3.0:1789048617.764218:0:13167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097682944 00010000:00010000:3.0:1789048617.764263:0:13167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776302 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29780 expref: 55 pid: 6499 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048617.764304:0:13167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:3.0:1789048617.764452:0:13167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+55:2393:x1875953097682944:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048617.764469:0:13167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048617.764477:0:13167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776302 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29780 expref: 55 pid: 6499 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.764490:0:13167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776302 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29780 expref: 55 pid: 6499 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.764510:0:13167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:3.0:1789048617.764528:0:13167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877631e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.764537:0:13167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877631e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.764545:0:13167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877631e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.764578:0:13167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789048617.764794:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776302 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29780 expref: 55 pid: 6499 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048617.764810:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b082ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1875953111404416:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789048617.764830:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877631e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.764850:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877631e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.764856:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877631e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048617.764908:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789048617.764912:0:6498:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789048617.764953:0:6498:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877631e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.764994:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08776317 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29787 expref: 55 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048617.765702:0:13167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+55:2393:x1875953097682944:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1387us (2402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048617.765712:0:13167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 59 00010000:00010000:2.0:1789048617.766487:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877631e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29787 expref: 53 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.766500:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:2.0:1789048617.766503:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789048617.766506:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0a00, rc 0) 00000100:00100000:2.0:1789048617.766564:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+53:11260:x1875953097682816:12345-192.168.202.16@tcp:101:bash.0 Request processed in 12632us (14590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048617.766571:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:0.0:1789048617.770296:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048617.770570:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097683200 00000100:00100000:1.0:1789048617.770579:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097683200 00000100:00100000:1.0:1789048617.770635:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:1.0:1789048617.770646:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2ad38450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+53:11260:x1875953097683200:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:1.0:1789048617.770873:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2ad38450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+54:11260:x1875953097683200:12345-192.168.202.16@tcp:35:bash.0 Request processed in 228us (584us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1789048617.770881:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:0.0:1789048617.873239:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048617.873599:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097683456 00000100:00100000:3.0:1789048617.873609:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097683456 00000100:00100000:2.0:1789048617.873798:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:2.0:1789048617.873807:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+54:11270:x1875953097683456:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048617.873829:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048617.873852:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776325 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2978e expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048617.873942:0:6499:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789048617.874043:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776325 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2978e expref: 56 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.874058:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c02b11400) 00010000:00010000:2.0:1789048617.874061:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789048617.874067:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776325 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2978e expref: 56 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.874081:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb0800, rc 0) 00000100:00100000:2.0:1789048617.874150:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+55:11270:x1875953097683456:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 343us (920us total) trans 4294967348 rc 301/301 00000100:00100000:2.0:1789048617.874158:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:0.0:1789048617.876181:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048617.876273:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097683584 00000100:00100000:3.0:1789048617.876281:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097683584 00000100:00100000:3.0:1789048617.876384:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:3.0:1789048617.876392:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+55:11270:x1875953097683584:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:3.0:1789048617.876458:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776333 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876470:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776333 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876479:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776333 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876485:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877633a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876490:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877633a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876494:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877633a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876546:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776341 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876564:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776341 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876569:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776341 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789048617.876607:0:12131:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776341 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876615:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776333 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876619:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776333 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876624:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776333 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876628:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3ca00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048617.876631:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776333 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876635:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776333 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876642:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:3.0:1789048617.876644:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048617.876648:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776333 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876651:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776333 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876665:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877633a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876668:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877633a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876672:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877633a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876675:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048617.876676:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877633a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876679:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877633a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876683:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c14162400) 00010000:00010000:3.0:1789048617.876685:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048617.876686:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877633a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876689:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877633a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876695:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776341 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876698:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776341 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876701:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776341 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876707:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048617.876709:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776341 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876712:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776341 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876716:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:3.0:1789048617.876718:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048617.876719:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776341 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048617.876722:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776341 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048617.876766:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+55:11270:x1875953097683584:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 375us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048617.876771:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:0.0:1789048617.878839:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048617.878938:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097683840 00000100:00100000:1.0:1789048617.878946:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097683840 00000100:00100000:2.0:1789048617.879159:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:2.0:1789048617.879172:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+55:11270:x1875953097683840:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789048617.879556:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+56:11270:x1875953097683840:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 388us (729us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789048617.879573:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:0.0:1789048617.915391:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048617.915488:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097684096 00000100:00100000:2.0:1789048617.915497:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097684096 00000100:00100000:2.0:1789048617.915558:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 72 00000100:00100000:2.0:1789048617.915568:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+56:11273:x1875953097684096:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048617.915591:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048617.915610:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776348 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29795 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.915683:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c0877634f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.915697:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c0877634f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.915708:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c0877634f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.915718:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776356 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.915725:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776356 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.915731:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776356 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.915849:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c0877635d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.915876:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c0877635d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.915884:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c0877635d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048617.915895:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789048617.915968:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c0877634f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.915976:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c0877634f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.915997:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c0877634f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.916003:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048617.916008:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c0877634f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.916017:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c0877634f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.916027:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:2.0:1789048617.916030:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048617.916152:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c0877634f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.916162:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c0877634f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.916177:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776356 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.916189:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776356 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.916196:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776356 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.916201:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048617.916204:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776356 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.916211:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776356 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.916219:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c14162400) 00010000:00010000:2.0:1789048617.916222:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048617.916225:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776356 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.916231:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776356 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.916265:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776348 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29795 expref: 59 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.916280:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c0877635d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29795 expref: 58 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.916288:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:2.0:1789048617.916290:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789048617.916298:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb0600, rc 0) 00000100:00100000:2.0:1789048617.916510:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+58:11273:x1875953097684096:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 942us (1128us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789048617.916518:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 72 00000100:00100000:0.0:1789048617.920730:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048617.920805:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097684224 00000100:00100000:2.0:1789048617.920815:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097684224 00000100:00100000:2.0:1789048617.920886:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 73 00000100:00100000:2.0:1789048617.920896:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+58:11273:x1875953097684224:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:2.0:1789048617.920962:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c0877636b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.920989:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c0877636b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.921001:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c0877636b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.921051:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c0877636b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.921059:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c0877636b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.921066:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c0877636b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.921072:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048617.921077:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c0877636b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.921085:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c0877636b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.921111:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:2.0:1789048617.921114:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789048617.921119:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c0877636b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.921125:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c0877636b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048617.921198:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+58:11273:x1875953097684224:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 303us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048617.921205:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 73 00000100:00100000:0.0:1789048617.922873:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048617.923015:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097684352 00000100:00100000:2.0:1789048617.923024:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097684352 00000100:00100000:2.0:1789048617.923099:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:2.0:1789048617.923108:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+58:2394:x1875953097684352:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048617.923122:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048617.923143:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c0877635d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29795 expref: 58 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048617.923160:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:2.0:1789048617.923165:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048617.923213:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+57:2394:x1875953097684352:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 106us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048617.923220:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:0.0:1789048617.929127:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048617.929234:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097684608 00000100:00100000:1.0:1789048617.929244:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097684608 00000100:00100000:1.0:1789048617.929312:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:1.0:1789048617.929379:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+57:11273:x1875953097684608:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1789048617.929575:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+58:11273:x1875953097684608:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 241us (458us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1789048617.929582:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00010000:00010000:2.0:1789048617.949633:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048618.127691:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048618.129079:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097684864 00000100:00100000:2.0:1789048618.129094:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097684864 00000100:00100000:2.0:1789048618.129188:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 74 00000100:00100000:2.0:1789048618.129198:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+58:11292:x1875953097684864:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:2.0:1789048618.129224:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048618.129247:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776372 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2979c expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.129383:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c08776379 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.129398:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c08776379 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.129411:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c08776379 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048618.129424:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789048618.129555:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776372 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2979c expref: 61 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.129574:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c08776379 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2979c expref: 60 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.129582:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:2.0:1789048618.129585:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789048618.129588:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb1c00, rc 0) 00000100:00100000:2.0:1789048618.129660:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+60:11292:x1875953097684864:12345-192.168.202.16@tcp:101:cat.0 Request processed in 464us (1981us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789048618.129668:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 74 00000001:00080000:0.0:1789048618.132639:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:0.0:1789048618.132695:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1789048618.132715:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff959b081130c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1789048618.132719:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff959c02a29f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff959b08113480 00000020:00080000:0.0:1789048618.132723:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff959c02a29000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff959b07abe400 00000100:00100000:2.0:1789048618.133682:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789048618.133718:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c04caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111404544:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789048618.133783:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048618.133856:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111404544 00000100:00100000:2.0:1789048618.133864:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111404544 00000100:00100000:2.0:1789048618.133924:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789048618.133934:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111404544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789048618.133967:0:8804:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1789048618.134013:0:8804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x18d3fa3cd4e1bf60, atime: 0x18d3fa3ceb05293a, ctime: 0x18d3fa3cd4e1bf60, blocks: 0x8 00010000:00010000:2.0:1789048618.134022:0:8804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008285468e/0x133f221c08776387 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.134038:0:8804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=372s v=(0 0) 00010000:00010000:2.0:1789048618.134043:0:8804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048618.134049:0:8804:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008285468e/0x133f221c08776387 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.134065:0:8804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008285468e/0x133f221c08776387 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.134076:0:8804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008285468e/0x133f221c08776387 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.134084:0:8804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008285468e/0x133f221c08776387 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.134102:0:8804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789048618.134238:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3623:x1875953111404544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 305us (454us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789048618.134251:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1789048618.134275:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048618.134281:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008285468e/0x133f221c08776387 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.134289:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0800 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048618.134294:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008285468e/0x133f221c08776387 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.134302:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008285468e/0x133f221c08776387 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.134318:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008285468e/0x133f221c08776387 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.134326:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008285468e/0x133f221c08776387 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.134376:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048618.134377:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048618.134379:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789048618.134411:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff959c04caa680/2, rc 0, transno 4294967302 00000100:00100000:2.0:1789048618.134417:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c04caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111404544:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1789048618.134986:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1789048618.135154:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00080000:1.0:1789048618.135167:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789048618.136208:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776157 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136222:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776157 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136229:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776157 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136235:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048618.136240:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776157 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136258:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776157 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136274:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff959c02b11600) 00010000:00010000:3.0:1789048618.136277:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048618.136282:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776157 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136288:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776157 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136307:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837e00/0x133f221c0877615e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136313:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837e00/0x133f221c0877615e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136319:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837e00/0x133f221c0877615e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136324:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048618.136327:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837e00/0x133f221c0877615e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136521:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837e00/0x133f221c0877615e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136532:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:3.0:1789048618.136535:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048618.136538:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837e00/0x133f221c0877615e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136554:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837e00/0x133f221c0877615e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136571:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c0877619d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136577:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c0877619d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136582:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c0877619d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136587:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048618.136590:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c0877619d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136595:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c0877619d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136603:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c14162400) 00010000:00010000:3.0:1789048618.136606:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048618.136608:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c0877619d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136613:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c0877619d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136629:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c087762a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136635:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c087762a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136647:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c087762a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136652:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048618.136655:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c087762a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136661:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c087762a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136668:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:3.0:1789048618.136671:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048618.136673:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c087762a7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136679:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c087762a7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136691:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087762ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136698:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087762ca lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136704:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087762ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136709:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048618.136712:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087762ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136728:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087762ca lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136736:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:3.0:1789048618.136739:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048618.136741:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087762ca lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136746:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087762ca lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136759:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776310 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136764:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776310 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136770:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776310 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136774:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3de00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048618.136777:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776310 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136782:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776310 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136789:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:3.0:1789048618.136791:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048618.136794:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776310 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.136812:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776310 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048618.166387:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048618.166479:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097684992 00000100:00100000:2.0:1789048618.166489:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097684992 00000100:00100000:2.0:1789048618.166553:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 75 00000100:00100000:2.0:1789048618.166562:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+13:11293:x1875953097684992:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048618.166597:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048618.166618:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c0877638e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b297a3 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.166677:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776395 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.166691:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.166702:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048618.166745:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789048618.166749:0:6498:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789048618.166767:0:6498:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.166790:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c0877638e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297a3 expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.166806:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776395 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297a3 expref: 14 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.166815:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:2.0:1789048618.166818:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789048618.166821:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb0600, rc 0) 00000100:00100000:2.0:1789048618.166882:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:11293:x1875953097684992:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 321us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048618.166889:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 75 00000100:00100000:3.0:1789048618.174571:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048618.174655:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097685376 00000100:00100000:1.0:1789048618.174665:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097685376 00000100:00100000:1.0:1789048618.174727:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:1.0:1789048618.174738:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:11293:x1875953097685376:12345-192.168.202.16@tcp:35:lfs.0 00000001:00080000:1.0:1789048618.174950:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967353 00000100:00100000:1.0:1789048618.175064:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:11293:x1875953097685376:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 327us (503us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789048618.175072:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000020:00080000:1.0:1789048618.175077:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789048618.179143:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048618.179260:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097685504 00000100:00100000:1.0:1789048618.179270:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097685504 00000100:00100000:3.0:1789048618.179442:0:13167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:3.0:1789048618.179455:0:13167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:11293:x1875953097685504:12345-192.168.202.16@tcp:103:lfs.0 00010000:00010000:3.0:1789048618.179473:0:13167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789048618.179500:0:13167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877631e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29787 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.179538:0:13167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c08776379 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2979c expref: 15 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.179552:0:13167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c0877621b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29741 expref: 14 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.179562:0:13167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:3.0:1789048618.179568:0:13167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048618.179626:0:13167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+13:11293:x1875953097685504:12345-192.168.202.16@tcp:103:lfs.0 Request processed in 175us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048618.179633:0:13167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:0.0:1789048618.182616:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048618.182749:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097685632 00000100:00100000:1.0:1789048618.182760:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097685632 00000100:00100000:1.0:1789048618.182827:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 76 00000100:00100000:1.0:1789048618.182850:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+13:11293:x1875953097685632:12345-192.168.202.16@tcp:58:lfs.0 00010000:00010000:1.0:1789048618.182975:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877639c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.183004:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877639c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.183031:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877639c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789048618.183281:0:8649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789048618.183471:0:8649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789048618.183571:0:8649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789048618.183651:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+13:11293:x1875953097685632:12345-192.168.202.16@tcp:58:lfs.0 Request processed in 802us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048618.183661:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 76 00000100:00100000:0.0:1789048618.217856:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048618.217956:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097685760 00000100:00100000:1.0:1789048618.217966:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097685760 00000100:00100000:1.0:1789048618.218055:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 77 00000100:00100000:1.0:1789048618.218067:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+13:11295:x1875953097685760:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789048618.218089:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048618.218110:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087763a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b297aa expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218177:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087763aa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218190:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087763aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218201:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087763aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218214:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087763b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218232:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087763b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218236:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087763b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218310:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087763b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218364:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087763b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218371:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087763b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048618.218408:0:6497:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789048618.218411:0:6497:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789048618.218425:0:6497:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087763b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218433:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087763b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218439:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087763aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218443:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087763aa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218447:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087763aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218458:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048618.218462:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087763aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218467:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087763aa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218476:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:1.0:1789048618.218478:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048618.218481:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087763aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218485:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087763aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218494:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087763b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218498:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087763b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218502:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087763b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218504:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048618.218506:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087763b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218509:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087763b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218519:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c3ef1fa00) 00010000:00010000:1.0:1789048618.218520:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048618.218522:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087763b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218525:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087763b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218548:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087763a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297aa expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218556:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087763b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297aa expref: 14 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.218560:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:1.0:1789048618.218561:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789048618.218563:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1e00, rc 0) 00000100:00100000:1.0:1789048618.218605:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:11295:x1875953097685760:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 543us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048618.218610:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 77 00000100:00100000:3.0:1789048618.461898:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111404800:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.461962:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048618.462056:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111405312:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.462094:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048618.462121:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111405824:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.462142:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048618.462172:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789048618.462178:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111404928:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.462203:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048618.462221:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111405440:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.462241:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048618.462260:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111405952:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.462278:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048618.462308:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111404800 00000100:00100000:3.0:1789048618.462316:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111404800 00000100:00100000:3.0:1789048618.462382:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111405312 00000100:00100000:3.0:1789048618.462386:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111405312 00000100:00100000:3.0:1789048618.462410:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111405824 00000100:00100000:3.0:1789048618.462413:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111405824 00000100:00100000:3.0:1789048618.462424:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111405440 00000100:00100000:3.0:1789048618.462426:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111405440 00000100:00100000:3.0:1789048618.462437:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111405952 00000100:00100000:3.0:1789048618.462439:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111405952 00000100:00100000:3.0:1789048618.462461:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789048618.462469:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111404800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048618.462517:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111405056:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.462518:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111404800:12345-0@lo:400:kworker.0 Request processed in 51us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048618.462525:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789048618.462542:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789048618.462545:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048618.462547:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111405312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048618.462558:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111405568:0@lo:400:kworker.0 00000100:00100000:0.0:1789048618.462579:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048618.462582:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111405312:12345-0@lo:400:kworker.0 Request processed in 36us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048618.462588:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789048618.462596:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111406080:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.462599:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111405056 00000100:00100000:3.0:1789048618.462602:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111405056 00000100:00100000:3.0:1789048618.462615:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1789048618.462616:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048618.462621:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111405824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048618.462639:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789048618.462645:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111405824:12345-0@lo:400:kworker.0 Request processed in 25us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048618.462645:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111404672:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.462651:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1789048618.462662:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789048618.462668:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111405440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048618.462669:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048618.462692:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111405440:12345-0@lo:400:kworker.0 Request processed in 25us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048618.462697:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789048618.462708:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789048618.462714:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111405952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048618.462720:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111405184:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.462739:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111405952:12345-0@lo:400:kworker.0 Request processed in 26us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048618.462741:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048618.462745:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789048618.462756:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789048618.462756:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111405696:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.462762:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111405056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048618.462775:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048618.462784:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111405056:12345-0@lo:400:kworker.0 Request processed in 23us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048618.462788:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111406208:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.462789:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789048618.462807:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048618.462818:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111404928 00000100:00100000:3.0:1789048618.462822:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111404928 00000100:00100000:0.0:1789048618.462838:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111405056:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.462843:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111405184 00000100:00100000:3.0:1789048618.462845:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111405184 00000100:00100000:3.0:1789048618.462856:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789048618.462862:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111404928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.462892:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111404928:12345-0@lo:400:kworker.0 Request processed in 31us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048618.462892:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111404672 00000100:00100000:0.0:1789048618.462896:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111404672 00000100:00100000:3.0:1789048618.462898:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789048618.462909:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789048618.462914:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111405184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048618.462926:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1789048618.462932:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111404672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.462945:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111405184:12345-0@lo:400:kworker.0 Request processed in 31us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048618.462950:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789048618.462958:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111404672:12345-0@lo:400:kworker.0 Request processed in 26us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048618.462963:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00080000:3.0:1789048618.462988:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789048618.462992:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048618.463000:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111405568 00000100:00100000:3.0:1789048618.463003:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111405568 00000100:00100000:3.0:1789048618.463026:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111406080 00000100:00100000:3.0:1789048618.463029:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111406080 00000100:00100000:3.0:1789048618.463043:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111405696 00000100:00100000:3.0:1789048618.463045:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111405696 00000100:00100000:3.0:1789048618.463055:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111406208 00000100:00100000:3.0:1789048618.463057:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111406208 00000100:00100000:3.0:1789048618.463067:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789048618.463073:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111405568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.463103:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111405568:12345-0@lo:400:kworker.0 Request processed in 30us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048618.463108:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789048618.463126:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789048618.463131:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111406080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.463160:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111406080:12345-0@lo:400:kworker.0 Request processed in 29us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048618.463166:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789048618.463176:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789048618.463182:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111405696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.463205:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111405696:12345-0@lo:400:kworker.0 Request processed in 24us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048618.463210:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789048618.463219:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789048618.463224:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3622:x1875953111406208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.463246:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3622:x1875953111406208:12345-0@lo:400:kworker.0 Request processed in 22us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048618.463251:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1789048618.463271:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789048618.463274:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789048618.463289:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111404672:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.463298:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111405184:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.463307:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111405696:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.463316:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111406208:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.463324:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111405568:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.463353:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111406080:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.463400:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111406336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048618.463427:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048618.463452:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111404928:0@lo:400:kworker.0 00010000:00080000:3.0:1789048618.463465:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b05d89880 x1875953111405440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048618.463475:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111405440:0@lo:400:kworker.0 00010000:00080000:3.0:1789048618.463484:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080a2680 x1875953111405952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048618.463492:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111405952:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.463503:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111404800:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.463513:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111405312:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.463522:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111405824:0@lo:400:kworker.0 00000100:00100000:3.0:1789048618.463550:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111406336 00000100:00100000:3.0:1789048618.463554:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111406336 00000100:00100000:3.0:1789048618.463578:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789048618.463584:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875953111406336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789048618.463606:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789048618.463742:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111406464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789048618.463771:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048618.463790:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111406464 00000100:00100000:1.0:1789048618.463794:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111406464 00000100:00100000:1.0:1789048618.463815:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789048618.463820:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111406464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789048618.463830:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048618.463866:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111406464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048618.463884:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789048618.464435:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111406464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789048618.464485:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111406336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048618.465034:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875953111406336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1448us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048618.465042:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000040:00080000:3.0:1789048618.656727:0:13779:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789048618.656740:0:13779:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789048618.656789:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789048618.656802:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789048618.656953:0:13779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fccf800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13779:1875953111406592:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789048618.657065:0:13779:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c03198180 going to sleep for 11 seconds 00000100:00100000:1.0:1789048618.663606:0:13779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fccf800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13779:1875953111406592:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789048618.677122:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048618.678064:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097685888 00000100:00100000:0.0:1789048618.678076:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097685888 00000100:00100000:0.0:1789048618.678137:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00100000:0.0:1789048618.678147:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:11306:x1875953097685888:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789048618.678182:0:8649:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789048618.678325:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:11306:x1875953097685888:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 179us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048618.678356:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00100000:0.0:1789048618.689507:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048618.689622:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097686016 00000100:00100000:1.0:1789048618.689632:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097686016 00000100:00100000:1.0:1789048618.689688:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 79 00000100:00100000:1.0:1789048618.689698:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:11306:x1875953097686016:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789048618.689774:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087763bf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.689793:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087763bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.689808:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087763bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.689875:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087763c6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.689883:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087763c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.689890:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087763c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.689915:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c087763cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.689923:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c087763cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.689937:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c087763cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048618.689998:0:6497:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789048618.690003:0:6497:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789048618.690015:0:6497:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c087763cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.690026:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087763bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.690033:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087763bf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.690040:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087763bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.690046:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048618.690050:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087763bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.690057:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087763bf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.690069:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff959c05322a00) 00010000:00010000:1.0:1789048618.690072:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048618.690077:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087763bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.690083:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087763bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.690105:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087763c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.690111:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087763c6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.690118:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087763c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.690123:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048618.690126:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087763c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.690131:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087763c6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.690139:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff959c3ef1fa00) 00010000:00010000:1.0:1789048618.690142:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048618.690144:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087763c6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.690150:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087763c6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.690164:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c087763cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.690171:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c087763cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.690177:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c087763cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.690191:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048618.690194:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c087763cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.690201:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c087763cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.690209:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:1.0:1789048618.690211:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048618.690214:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c087763cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.690218:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c087763cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048618.690304:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:11306:x1875953097686016:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 Request processed in 607us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048618.690312:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 79 00000100:00100000:0.0:1789048618.698300:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048618.698511:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097686272 00000100:00100000:1.0:1789048618.698522:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097686272 00000100:00100000:1.0:1789048618.698582:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 80 00000100:00100000:1.0:1789048618.698590:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:11306:x1875953097686272:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789048618.698610:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048618.698630:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c087763d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b297b1 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.698739:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087763db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.698767:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087763db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.698779:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087763db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048618.698795:0:6499:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789048618.698884:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087763db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.698892:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087763db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.698899:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087763db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.698906:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048618.698910:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087763db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.698919:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087763db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.698933:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:1.0:1789048618.698937:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789048618.698942:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087763db lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.698949:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087763db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.699002:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c087763d4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297b1 expref: 16 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.699019:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff959c05322a00) 00010000:00010000:1.0:1789048618.699022:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789048618.699026:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c087763d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297b1 expref: 16 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.699036:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0e00, rc 0) 00000100:00100000:1.0:1789048618.699179:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+15:11306:x1875953097686272:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 588us (887us total) trans 4294967355 rc 301/301 00000100:00100000:1.0:1789048618.699187:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 80 00000100:00100000:0.0:1789048618.703061:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048618.703198:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097686400 00000100:00100000:3.0:1789048618.703209:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097686400 00000100:00100000:3.0:1789048618.703263:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00100000:3.0:1789048618.703273:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+15:11306:x1875953097686400:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789048618.703307:0:12131:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789048618.703570:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+15:11306:x1875953097686400:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 297us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048618.703577:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00100000:3.0:1789048618.707650:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048618.707895:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097686656 00000100:00100000:0.0:1789048618.707906:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097686656 00000100:00100000:0.0:1789048618.707980:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 82 00000100:00100000:0.0:1789048618.707992:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+15:11306:x1875953097686656:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789048618.708012:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048618.708016:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789048618.708053:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776395 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297a3 expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.708072:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:0.0:1789048618.708078:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789048618.708094:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c087763e9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b297b8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789048618.708519:0:6498:0:(osp_object.c:1667:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1789048618.708663:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087763f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.708676:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087763f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.708686:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087763f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.708737:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c087763e9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297b8 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.708753:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087763f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297b8 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.708780:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff959c18359e00) 00010000:00010000:0.0:1789048618.708783:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048618.708785:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39a00, rc 0) 00000100:00100000:0.0:1789048618.708852:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:11306:x1875953097686656:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 861us (1211us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1789048618.708859:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 82 00000100:00100000:3.0:1789048618.712786:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048618.712894:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097686912 00000100:00100000:2.0:1789048618.712903:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097686912 00000100:00100000:2.0:1789048618.712952:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 83 00000100:00100000:2.0:1789048618.712962:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:11306:x1875953097686912:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789048618.714132:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048618.714164:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087763f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297b8 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.714181:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff959c18359e00) 00010000:00010000:2.0:1789048618.714193:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789048618.714218:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c087763fe lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.714230:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c087763fe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.714239:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c087763fe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.714299:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776405 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x3391f7a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.714306:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776405 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3391f7a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.714327:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776405 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3391f7a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.714388:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c087763fe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.714395:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c087763fe lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.714401:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c087763fe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.714407:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048618.714411:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c087763fe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.714419:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c087763fe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.714427:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:2.0:1789048618.714430:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048618.714434:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c087763fe lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.714440:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c087763fe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.714448:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776405 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3391f7a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.714455:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776405 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3391f7a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.714466:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776405 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3391f7a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.714470:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048618.714472:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776405 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3391f7a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.714479:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776405 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3391f7a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.714486:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x3391f7a1 (ffff959c02b11100) 00010000:00010000:2.0:1789048618.714488:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048618.714490:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776405 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3391f7a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.714496:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776405 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3391f7a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048618.714587:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+15:11306:x1875953097686912:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 1626us (1808us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789048618.714595:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 83 00000100:00100000:3.0:1789048618.718441:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048618.719130:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097687040 00000100:00100000:2.0:1789048618.719140:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097687040 00000100:00100000:2.0:1789048618.719212:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 84 00000100:00100000:2.0:1789048618.719222:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+15:11306:x1875953097687040:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789048618.719242:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048618.719268:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c0877640c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b297bf expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.719362:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776413 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.719376:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.719388:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.719506:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c0877640c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297bf expref: 17 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.719525:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776413 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297bf expref: 16 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.719534:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff959c02b11700) 00010000:00010000:2.0:1789048618.719537:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789048618.719540:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb1200, rc 0) 00000100:00100000:2.0:1789048618.719601:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:11306:x1875953097687040:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 381us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048618.719607:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 84 00000100:00100000:3.0:1789048618.725233:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048618.725380:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097687296 00000100:00100000:1.0:1789048618.725391:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097687296 00000100:00100000:1.0:1789048618.725445:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 85 00000100:00100000:1.0:1789048618.725456:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:11306:x1875953097687296:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789048618.725539:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c0877641a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.725556:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c0877641a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.725567:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c0877641a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789048618.725758:0:8649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1789048618.725769:0:8649:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373479435128ns, next at 374479432338ns, rc = 0 00000004:00010000:1.0:1789048618.725822:0:8649:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000039759bb0 reply state 00000000e33b959e transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c0877641a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.725855:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c0877641a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.725862:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff959c02b11700) 00010000:00010000:1.0:1789048618.725864:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789048618.725868:0:8649:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789048618.725958:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+18:11306:x1875953097687296:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 503us (734us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1789048618.725966:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 85 00000100:00100000:3.0:1789048618.734808:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048618.734886:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097687424 00000100:00100000:1.0:1789048618.734895:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097687424 00000100:00100000:1.0:1789048618.734955:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 86 00000100:00100000:1.0:1789048618.734967:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+18:11306:x1875953097687424:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789048618.735007:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048618.735038:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776421 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b297c6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.735094:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776421 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297c6 expref: 19 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.735110:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776421 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297c6 expref: 19 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.735127:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff959c02b11700) 00010000:00010000:1.0:1789048618.735130:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789048618.735133:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0c00, rc 0) 00000100:00100000:1.0:1789048618.735195:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+19:11306:x1875953097687424:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 230us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048618.735215:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 86 00000100:00100000:3.0:1789048618.738531:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048618.738692:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097687552 00000100:00100000:1.0:1789048618.738703:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097687552 00000100:00100000:1.0:1789048618.738742:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:1.0:1789048618.738752:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1875953097687552:12345-192.168.202.16@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1789048618.738788:0:8412:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp t0 exp 0000000000000000 cur 373 last 0 00000020:00000080:1.0:1789048618.738818:0:8412:0:(genops.c:1384:class_connect()) connect: client 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b, cookie 0x133f221c08776428 00002000:00100000:1.0:1789048618.738831:0:8412:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b/ffff959c064a8000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789048618.738849:0:8412:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789048618.738925:0:8412:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789048618.738955:0:8412:0:(import.c:65:import_set_state_nolock()) ffff959c064a8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789048618.739045:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2390:x1875953097687552:12345-192.168.202.16@tcp:8:lhsmtool_posix.0 Request processed in 292us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048618.739053:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:1.0:1789048618.743126:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048618.743299:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097687680 00000100:00100000:3.0:1789048618.743310:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097687680 00000100:00100000:3.0:1789048618.743577:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:3.0:1789048618.743588:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:0:x1875953097687680:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789048618.743789:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789048618.755827:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:2.0:1789048618.755849:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 00000100:00100000:3.0:1789048618.756300:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:0:x1875953097687680:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 12708us (13177us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789048618.756312:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:2.0:1789048618.765252:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048618.766892:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097687936 00000100:00100000:1.0:1789048618.766908:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097687936 00000100:00100000:1.0:1789048618.767042:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:1.0:1789048618.767055:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+19:11306:x1875953097687936:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789048618.767303:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:11306:x1875953097687936:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 251us (2062us total) trans 4294967358 rc 0/0 00000100:00100000:1.0:1789048618.767311:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:0.0:1789048618.769717:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048618.769828:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097688192 00000100:00100000:3.0:1789048618.769859:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097688192 00000100:00100000:3.0:1789048618.769921:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 87 00000100:00100000:3.0:1789048618.769933:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:11306:x1875953097688192:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789048618.770073:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:11306:x1875953097688192:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 141us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048618.770081:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 87 00000100:00100000:3.0:1789048618.772833:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048618.774124:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097688320 00000100:00100000:2.0:1789048618.774137:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097688320 00000100:00100000:2.0:1789048618.774216:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 88 00000100:00100000:2.0:1789048618.774229:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:11306:x1875953097688320:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789048618.774265:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048618.774289:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c0877642f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b297cd expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.774423:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776436 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.774439:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776436 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.774452:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776436 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048618.774500:0:6499:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789048618.774520:0:6499:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776436 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.774548:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c0877642f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297cd expref: 22 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.774569:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776436 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297cd expref: 21 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.774577:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff959c02b11700) 00010000:00010000:2.0:1789048618.774579:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789048618.774583:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb1a00, rc 0) 00000100:00100000:2.0:1789048618.774647:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+21:11306:x1875953097688320:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 422us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048618.774655:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 88 00000100:00100000:3.0:1789048618.777616:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048618.777715:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097688448 00000100:00100000:1.0:1789048618.777728:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097688448 00000100:00100000:1.0:1789048618.777813:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:1.0:1789048618.777822:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097688448:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789048618.777840:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048618.777859:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007013a391/0x133f221c0877643d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b297d4 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789048618.777879:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fa3d917c2440, blocks: 0x0 00010000:00010000:1.0:1789048618.777894:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=373s v=(0 0) 00010000:00010000:1.0:1789048618.777898:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048618.777906:0:8412:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007013a391/0x133f221c0877643d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297d4 expref: 6 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.777928:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007013a391/0x133f221c0877643d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297d4 expref: 6 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.777940:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0800, rc 0) 00000100:00100000:1.0:1789048618.778508:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097688448:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 197us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048618.778515:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:0.0:1789048618.781371:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048618.781434:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097688704 00000100:00100000:3.0:1789048618.781444:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097688704 00000100:00100000:3.0:1789048618.781506:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 89 00000100:00100000:3.0:1789048618.781516:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+21:11306:x1875953097688704:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789048618.781600:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+21:11306:x1875953097688704:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 87us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048618.781605:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 89 00000100:00100000:0.0:1789048618.787836:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048618.788786:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097688832 00000100:00100000:2.0:1789048618.788800:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097688832 00000100:00100000:2.0:1789048618.788868:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:2.0:1789048618.788879:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:11306:x1875953097688832:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789048618.788900:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048618.788922:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037d25607/0x133f221c08776444 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b297db expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.788953:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007013a391/0x133f221c0877643d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297d4 expref: 7 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.788963:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048618.788967:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048618.788983:0:8414:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037d25607/0x133f221c08776444 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297db expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.789018:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007013a391/0x133f221c0877643d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297d4 expref: 7 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.789032:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007013a391/0x133f221c0877643d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297d4 expref: 7 pid: 8412 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048618.789046:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c04ca9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1875953111406720:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789048618.789152:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b081133c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048618.792509:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c04ca9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1875953111406720:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789048618.792511:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:3.0:1789048618.792549:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000037d25607/0x133f221c08776444 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b297db expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.792574:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb1e00, rc 0) 00000100:00100000:1.0:1789048618.792773:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097688960 00000100:00100000:1.0:1789048618.792782:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097688960 00010000:00010000:1.0:1789048618.792824:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007013a391/0x133f221c0877643d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297d4 expref: 8 pid: 8412 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048618.792865:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:1.0:1789048618.792874:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2394:x1875953097688960:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048618.792895:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048618.792918:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007013a391/0x133f221c0877643d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297d4 expref: 8 pid: 8412 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.792932:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007013a391/0x133f221c0877643d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297d4 expref: 8 pid: 8412 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.792955:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007013a391/0x133f221c0877643d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297d4 expref: 8 pid: 8412 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.792983:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048618.792987:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048618.792995:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000037d25607/0x133f221c08776444 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b297db expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.793006:0:6481:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037d25607/0x133f221c08776444 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b297db expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.793056:0:6481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000037d25607/0x133f221c08776444 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b297db expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048618.793070:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6481:1875953111406848:192.168.202.16@tcp:105: 00000100:00100000:3.0:1789048618.793293:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:11306:x1875953097688832:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 4414us (5466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048618.793308:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:1.0:1789048618.793719:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789048618.803122:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6481:1875953111406848:192.168.202.16@tcp:105: 00010000:00010000:2.0:1789048618.803158:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048618.803170:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048618.803223:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097689088 00000100:00100000:2.0:1789048618.803231:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097688960:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 10356us (10722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048618.803234:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097689088 00000100:00100000:2.0:1789048618.803246:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 60 00002000:00100000:1.0:1789048618.803291:0:8419:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff959c3fcd0700 x1875953097689088/t0(0) o4->85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp:629/0 lens 504/0 e 0 to 0 dl 1789048629 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789048618.803308:0:8419:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959c3fcd0700 with x1875953097689088 ext(0->8) 00002000:00010000:1.0:1789048618.803314:0:8419:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff959c3fcd0700 00000100:00100000:1.0:1789048618.803413:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:1.0:1789048618.803423:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2392:x1875953097689088:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789048618.806460:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2392:x1875953097689088:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 Request processed in 3027us (3278us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789048618.806474:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00002000:00100000:1.0:1789048618.806487:0:8419:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff959c3fcd0700 x1875953097689088/t4294967303(0) o4->85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp:629/0 lens 504/448 e 0 to 0 dl 1789048629 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789048618.806499:0:8419:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959c3fcd0700 with x1875953097689088 ext(0->8) 00002000:00010000:1.0:1789048618.806505:0:8419:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff959c3fcd0700 00000100:00100000:1.0:1789048618.808721:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048618.808757:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097689216 00000100:00100000:1.0:1789048618.808766:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097689216 00000100:00100000:1.0:1789048618.808825:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 90 00000100:00100000:1.0:1789048618.808837:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+21:11306:x1875953097689216:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789048618.814864:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967358 is committed 00000004:00080000:1.0:1789048618.814883:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789048618.814907:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1789048618.814928:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1789048618.814938:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:3.0:1789048618.814982:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c0877641a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.815007:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c0877641a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.815014:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c0877641a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.815020:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048618.815026:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c0877641a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.815035:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c0877641a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.815052:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff959c02b11700) 00010000:00010000:3.0:1789048618.815055:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789048618.815060:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c0877641a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.815067:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c0877641a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048618.815153:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:11306:x1875953097689216:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 Request processed in 6313us (6436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048618.815165:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 90 00000100:00100000:3.0:1789048618.815185:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111406976:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789048618.815246:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048618.815305:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111406976 00000100:00100000:3.0:1789048618.815313:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111406976 00000100:00100000:3.0:1789048618.815378:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789048618.815388:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111406976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789048618.818075:0:8413:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789048618.818080:0:8413:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789048619414485360 00002000:00010000:3.0:1789048618.818088:0:8413:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789048618.818090:0:8413:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789048619337000000 -> 1789048619414485360 00002000:00010000:3.0:1789048618.818094:0:8413:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789048618.818182:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1875953111406976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2793us (2933us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789048618.818193:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1789048618.818955:0:3622:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff959c3fccc700/2, rc 0, transno 4294967304 00000100:00100000:2.0:1789048618.818966:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111406976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789048618.824869:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048618.826120:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097689344 00000100:00100000:3.0:1789048618.826130:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097689344 00000100:00100000:3.0:1789048618.826230:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:3.0:1789048618.826241:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2393:x1875953097689344:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789048618.827763:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1789048618.827777:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1789048618.827914:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097689344:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 Request processed in 1671us (3050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048618.827925:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:2.0:1789048618.832318:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048618.832484:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097689600 00000100:00100000:3.0:1789048618.832495:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097689600 00000100:00100000:3.0:1789048618.832558:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 91 00000100:00100000:3.0:1789048618.832568:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:11306:x1875953097689600:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789048618.832623:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048618.832654:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776436 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297cd expref: 14 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.832682:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff959c02b11700) 00010000:00010000:3.0:1789048618.832688:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789048618.832728:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c0877644b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.832743:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c0877644b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.832761:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c0877644b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789048618.832903:0:6499:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000e4d40ce5 reply state 000000008b781e9a transno 4294967359 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c0877644b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.832917:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c0877644b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.832923:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff959c02b11700) 00010000:00010000:3.0:1789048618.832926:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789048618.832928:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789048618.833036:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+15:11306:x1875953097689600:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 468us (726us total) trans 4294967359 rc 0/0 00000100:00100000:3.0:1789048618.833043:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 91 00000100:00100000:0.0:1789048618.836103:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048618.836142:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097689728 00000100:00100000:3.0:1789048618.836154:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097689728 00000100:00100000:3.0:1789048618.836213:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:3.0:1789048618.836223:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097689728:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789048618.836617:0:8413:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789048618.836621:0:8413:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789048619414485360 -> 1789048618382000000 00002000:00010000:3.0:1789048618.836624:0:8413:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789048616543000000 00002000:00010000:3.0:1789048618.836626:0:8413:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789048619414485360 -> 1789048618382000000 00002000:00010000:3.0:1789048618.836628:0:8413:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789048618.836697:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2394:x1875953097689728:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 474us (602us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789048618.836957:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:2.0:1789048618.840453:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048618.840573:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097689984 00000100:00100000:0.0:1789048618.840583:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097689984 00000100:00100000:0.0:1789048618.840671:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 92 00000100:00100000:0.0:1789048618.840682:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+15:11306:x1875953097689984:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789048618.840762:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08776452 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.840782:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776413 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297bf expref: 15 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.840792:0:6498:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08776452 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.840836:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776413 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297bf expref: 15 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.840851:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776413 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297bf expref: 15 pid: 12131 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048618.840865:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1875953111407104:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789048618.840964:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c37fc00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048618.844101:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1875953111407104:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789048618.844102:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:0.0:1789048618.844131:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08776452 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048618.844390:0:13167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097690112 00000100:00100000:3.0:1789048618.844397:0:13167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097690112 00010000:00010000:3.0:1789048618.844433:0:13167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776413 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297bf expref: 16 pid: 12131 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048618.844469:0:13167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:3.0:1789048618.844479:0:13167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:2393:x1875953097690112:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048618.844492:0:13167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048618.844499:0:13167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776413 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297bf expref: 16 pid: 12131 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.844509:0:13167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776413 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297bf expref: 16 pid: 12131 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.844529:0:13167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776413 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297bf expref: 16 pid: 12131 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.844542:0:13167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff959c02b11700) 00010000:00010000:3.0:1789048618.844547:0:13167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08776452 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.844556:0:13167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08776452 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.844563:0:13167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08776452 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.844633:0:13167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048618.844700:0:13167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+15:2393:x1875953097690112:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 221us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048618.844718:0:13167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 61 00010000:00010000:0.0:1789048618.845215:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08776452 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.845226:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08776452 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.845267:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08776452 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.845275:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08776452 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.845283:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08776452 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.845289:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048618.845294:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08776452 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.845308:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08776452 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.845320:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff959c02b11700) 00010000:00010000:0.0:1789048618.845323:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789048618.845328:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08776452 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.845831:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08776452 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048618.845905:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:11306:x1875953097689984:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 Request processed in 5222us (5460us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789048618.845914:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 92 00000100:00100000:1.0:1789048618.849760:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048618.849881:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097690240 00000100:00100000:3.0:1789048618.849890:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097690240 00000100:00100000:3.0:1789048618.849947:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:3.0:1789048618.849955:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2394:x1875953097690240:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789048618.850010:0:8414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08776459 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.850032:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000037d25607/0x133f221c08776444 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b297db expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.850041:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048618.850046:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789048618.850051:0:8414:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08776459 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.850087:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000037d25607/0x133f221c08776444 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0xd796648991b297db expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.850101:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000037d25607/0x133f221c08776444 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b297db expref: 7 pid: 8414 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048618.850116:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1875953111407232:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048618.850269:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c05d31e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789048618.855696:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048618.855724:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097690368 00000100:00100000:1.0:1789048618.855732:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097690368 00010000:00010000:1.0:1789048618.855770:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000037d25607/0x133f221c08776444 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b297db expref: 8 pid: 8414 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048618.855805:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:1.0:1789048618.855812:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2aece050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2393:x1875953097690368:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048618.855823:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048618.855840:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000037d25607/0x133f221c08776444 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b297db expref: 8 pid: 8414 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.855850:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000037d25607/0x133f221c08776444 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b297db expref: 8 pid: 8414 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.855871:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789048618.855876:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789048618.855881:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08776459 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.855891:0:6482:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08776459 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.855912:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048618.855955:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2aece050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2393:x1875953097690368:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 143us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048618.855965:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 62 00010000:00010000:3.0:1789048618.856486:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037d25607/0x133f221c08776444 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b297db expref: 7 pid: 8414 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048618.856509:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1875953111407232:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048618.856531:0:8414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08776459 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.856541:0:8414:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08776459 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.856548:0:8414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08776459 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.856568:0:8414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08776459 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.856577:0:8414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08776459 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.856586:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08776459 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.856592:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3de00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048618.856597:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08776459 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.856605:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08776459 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.856627:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08776459 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.856635:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08776459 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048618.856699:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097690240:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 Request processed in 6744us (6950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048618.856708:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:1.0:1789048618.864959:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048618.865155:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097690624 00000100:00100000:3.0:1789048618.865168:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097690624 00000100:00100000:3.0:1789048618.865259:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 93 00000100:00100000:3.0:1789048618.865270:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:11306:x1875953097690624:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789048618.865492:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776460 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.865514:0:8649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087762a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29764 expref: 14 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.865523:0:8649:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776460 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.865558:0:8649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087762a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29764 expref: 14 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.865572:0:8649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087762a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29764 expref: 14 pid: 12131 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048618.865592:0:8649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8649:1875953111407360:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048618.865796:0:8649:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c05d31e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789048618.870846:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048618.870929:0:8649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8649:1875953111407360:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789048618.870958:0:8649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776460 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048618.871011:0:13167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097690752 00000100:00100000:0.0:1789048618.871020:0:13167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097690752 00010000:00010000:0.0:1789048618.871059:0:13167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087762a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29764 expref: 15 pid: 12131 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048618.871097:0:13167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:0.0:1789048618.871106:0:13167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+15:2393:x1875953097690752:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048618.871120:0:13167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048618.871127:0:13167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087762a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29764 expref: 15 pid: 12131 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.871139:0:13167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087762a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29764 expref: 15 pid: 12131 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.871172:0:13167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087762a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29764 expref: 15 pid: 12131 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.871185:0:13167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:0.0:1789048618.871189:0:13167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776460 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.871200:0:13167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776460 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.871208:0:13167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776460 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.871231:0:13167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789048618.871246:0:8649:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776460 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.871254:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776460 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048618.871324:0:13167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:2393:x1875953097690752:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 218us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048618.871509:0:13167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 63 00010000:00010000:1.0:1789048618.871530:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776467 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.871543:0:8649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776421 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297c6 expref: 14 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.871551:0:8649:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776467 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.871582:0:8649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776421 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297c6 expref: 14 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.871596:0:8649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776421 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297c6 expref: 14 pid: 6497 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048618.871608:0:8649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c064b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8649:1875953111407488:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789048618.871662:0:8649:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048618.875146:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048618.875256:0:8649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c064b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8649:1875953111407488:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048618.875283:0:8649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776467 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048618.876951:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097690880 00000100:00100000:0.0:1789048618.876964:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097690880 00010000:00010000:0.0:1789048618.877019:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776421 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297c6 expref: 15 pid: 6497 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048618.877103:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:0.0:1789048618.877113:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+15:2393:x1875953097690880:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048618.877130:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048618.877137:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776421 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297c6 expref: 15 pid: 6497 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.877161:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776421 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297c6 expref: 15 pid: 6497 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.877184:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776421 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297c6 expref: 15 pid: 6497 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.877199:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff959c02b11700) 00010000:00010000:0.0:1789048618.877205:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776467 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.877215:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776467 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.877223:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776467 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.877258:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048618.877356:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:2393:x1875953097690880:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 219us (2195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048618.877365:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 64 00010000:00010000:3.0:1789048618.877503:0:8649:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776467 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048618.877512:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776467 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789048618.877624:0:8649:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000001:00080000:3.0:1789048618.877760:0:8649:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000001:00080000:3.0:1789048618.877801:0:8649:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00000100:00100000:3.0:1789048618.877885:0:8649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8649:1875953111407616:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789048618.877944:0:8649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048618.877996:0:8649:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b07b08a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789048618.878177:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111407616 00000100:00100000:2.0:1789048618.878183:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111407616 00000100:00100000:2.0:1789048618.878228:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789048618.878236:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8649:x1875953111407616:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789048618.878836:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8649:x1875953111407616:12345-0@lo:1000:mdt00_003.0 Request processed in 598us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048618.878846:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789048618.878894:0:8649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1789048618.878901:0:8649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff959c3fccc700, transno 4294967304 00000100:00100000:3.0:1789048618.878921:0:8649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8649:1875953111407616:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789048618.879060:0:8649:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00000100:00100000:3.0:1789048618.879113:0:8649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8649:1875953111407744:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789048618.879164:0:8649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048618.881465:0:8649:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b07b08840 going to sleep for 11 seconds 00000100:00100000:1.0:1789048618.881926:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111407744 00000100:00100000:1.0:1789048618.881937:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111407744 00000100:00100000:0.0:1789048618.882097:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789048618.882108:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0884b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8649:x1875953111407744:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789048618.882395:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0884b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8649:x1875953111407744:12345-0@lo:1000:mdt00_003.0 Request processed in 288us (3229us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789048618.882405:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789048618.882480:0:8649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8649:1875953111407744:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789048618.882534:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776467 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.882545:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776467 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.882553:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776467 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.882560:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048618.882565:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776467 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.882573:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776467 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.882591:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff959c02b11700) 00010000:00010000:1.0:1789048618.882594:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789048618.882599:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776467 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.882606:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776467 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.882636:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877639c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.882652:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877639c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.882658:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877639c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.882663:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048618.882666:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877639c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.882815:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877639c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.882825:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:1.0:1789048618.882828:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789048618.882831:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877639c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.882837:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877639c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.882860:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877646e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.882875:0:8649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087763b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297aa expref: 17 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.882884:0:8649:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877646e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.882916:0:8649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087763b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297aa expref: 17 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.882938:0:8649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087763b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297aa expref: 17 pid: 6497 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048618.882953:0:8649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c064b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8649:1875953111407872:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789048618.883041:0:8649:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789048618.887424:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048618.887459:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097691008 00000100:00100000:1.0:1789048618.887469:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097691008 00010000:00010000:1.0:1789048618.887507:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087763b8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297aa expref: 18 pid: 6497 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048618.887535:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:1.0:1789048618.887541:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+18:2393:x1875953097691008:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048618.887553:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048618.887558:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087763b8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297aa expref: 18 pid: 6497 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.887567:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087763b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297aa expref: 18 pid: 6497 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.887585:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:1.0:1789048618.887590:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877646e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.887597:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877646e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.887612:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877646e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.887628:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048618.887724:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+18:2393:x1875953097691008:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 127us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048618.887732:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 65 00010000:00010000:0.0:1789048618.888068:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087763b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297aa expref: 17 pid: 6497 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048618.888095:0:8649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c064b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8649:1875953111407872:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048618.888116:0:8649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877646e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.888124:0:8649:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877646e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.888130:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877646e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.888141:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877646e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.888146:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877646e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.888152:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877646e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.888158:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048618.888161:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877646e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.888167:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877646e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.888176:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:0.0:1789048618.888178:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048618.888181:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877646e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.888196:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877646e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.888208:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776460 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.888213:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776460 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.888219:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776460 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.888224:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3de00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048618.888227:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776460 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.888232:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776460 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.888241:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c02b11e00) 00010000:00010000:0.0:1789048618.888243:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789048618.888246:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776460 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048618.888251:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776460 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048618.888434:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:11306:x1875953097690624:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 23165us (23487us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1789048618.888444:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 93 00000020:00080000:0.0:1789048618.888453:0:8649:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789048618.888596:0:13779:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789048618.888602:0:13779:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789048618.888617:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789048618.888622:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789048618.892505:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048618.892625:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097691264 00000100:00100000:3.0:1789048618.892646:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097691264 00000100:00100000:3.0:1789048618.892775:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:3.0:1789048618.892788:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:11306:x1875953097691264:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789048618.895237:0:6500:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789048618.895298:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967365 00010000:00010000:2.0:1789048618.895348:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c08776475 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.895366:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c08776475 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.895379:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c08776475 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.895389:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c08776475 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.895403:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c08776475 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.895410:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c08776475 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048618.895435:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789048618.895474:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048618.895482:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c08776475 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.895489:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0c00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048618.895493:0:7447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c08776475 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.895500:0:7447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c08776475 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.895512:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff959c02b11700) 00010000:00010000:1.0:1789048618.895516:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789048618.895520:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c08776475 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.895525:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c08776475 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048618.895547:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048618.895548:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048618.895550:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048618.895558:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+18:11306:x1875953097691264:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 2768us (3061us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789048618.895567:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00000020:00080000:2.0:1789048618.895573:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1789048618.907551:0:14190:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789048618.907560:0:14190:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789048618.907584:0:14190:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789048618.907590:0:14190:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789048618.975042:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111408000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789048618.975121:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048618.975637:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111408000 00000100:00100000:0.0:1789048618.975646:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111408000 00000100:00100000:0.0:1789048618.975779:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789048618.975792:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111408000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789048618.975959:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789048618.976029:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111408000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 241us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048618.976037:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789048618.976088:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111408000:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789048618.976275:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048619.062623:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048619.062766:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097691520 00000100:00100000:0.0:1789048619.062777:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097691520 00000100:00100000:0.0:1789048619.062837:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 94 00000100:00100000:0.0:1789048619.062846:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0884b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+18:11316:x1875953097691520:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789048619.062879:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048619.062904:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c0877647c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b297e2 expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789048619.063028:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789048619.063176:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08776483 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.063193:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08776483 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.063206:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08776483 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048619.063230:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789048619.063439:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c0877647c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297e2 expref: 21 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.063459:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08776483 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297e2 expref: 20 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.063467:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:0.0:1789048619.063470:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789048619.063473:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39e00, rc 0) 00000100:00100000:0.0:1789048619.063563:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0884b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:11316:x1875953097691520:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 718us (946us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1789048619.063570:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 94 00000100:00100000:3.0:1789048619.066644:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048619.067014:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097691648 00000100:00100000:0.0:1789048619.067177:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097691648 00000100:00100000:0.0:1789048619.067245:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 95 00000100:00100000:0.0:1789048619.067256:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:11316:x1875953097691648:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:0.0:1789048619.067434:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776491 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067454:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776491 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067466:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776491 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067483:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776498 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067498:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776498 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067505:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776498 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067580:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877649f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067589:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877649f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067596:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877649f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789048619.067644:0:6498:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877649f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067657:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776491 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067662:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776491 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067669:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776491 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067674:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048619.067678:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776491 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067685:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776491 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067778:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:0.0:1789048619.067782:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048619.067787:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776491 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067792:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776491 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067806:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776498 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067811:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776498 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067816:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776498 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067821:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048619.067823:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776498 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067829:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776498 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067836:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c18359600) 00010000:00010000:0.0:1789048619.067838:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048619.067840:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776498 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067845:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776498 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067872:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877649f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067879:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877649f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067884:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877649f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067890:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048619.067892:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877649f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067898:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877649f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067906:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c18359200) 00010000:00010000:0.0:1789048619.067909:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048619.067911:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877649f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.067917:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c0877649f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048619.068807:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:11316:x1875953097691648:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 1547us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048619.068818:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 95 00000100:00100000:2.0:1789048619.108438:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048619.108499:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097691904 00000100:00100000:0.0:1789048619.108509:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097691904 00000100:00100000:0.0:1789048619.108576:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 96 00000100:00100000:0.0:1789048619.108600:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:11319:x1875953097691904:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789048619.108621:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048619.108644:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c087764a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b297e9 expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.108731:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087764ad lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.108746:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087764ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110086:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087764ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110125:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110136:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110146:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110263:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087764bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110271:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087764bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110279:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087764bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048619.110316:0:8649:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789048619.110423:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087764ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110429:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087764ad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110434:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087764ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110437:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048619.110440:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087764ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110446:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087764ad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110455:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:0.0:1789048619.110457:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048619.110460:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087764ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110464:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087764ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110473:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110476:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110488:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110491:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048619.110493:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110496:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110500:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c18359200) 00010000:00010000:0.0:1789048619.110502:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048619.110503:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110506:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110542:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c087764a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297e9 expref: 23 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110551:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087764bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297e9 expref: 22 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.110556:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c18359600) 00010000:00010000:0.0:1789048619.110557:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048619.110558:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38e00, rc 0) 00000100:00100000:0.0:1789048619.110619:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+22:11319:x1875953097691904:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 2021us (2322us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1789048619.110635:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 96 00000100:00100000:3.0:1789048619.114454:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048619.114555:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097692032 00000100:00100000:0.0:1789048619.114565:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097692032 00000100:00100000:0.0:1789048619.114627:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 97 00000100:00100000:0.0:1789048619.114637:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0884a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+22:11319:x1875953097692032:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:1.0:1789048619.114875:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.114892:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.114904:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.114942:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.114950:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.114956:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.114963:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048619.114979:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.114987:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.115641:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c18359600) 00010000:00010000:1.0:1789048619.115646:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789048619.115652:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.115680:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048619.116221:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0884a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+22:11319:x1875953097692032:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 1581us (1772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048619.116230:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 97 00000100:00100000:3.0:1789048619.122665:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048619.122909:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097692288 00000100:00100000:1.0:1789048619.122921:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097692288 00000100:00100000:1.0:1789048619.123006:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:1.0:1789048619.123018:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2ad38850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+22:11319:x1875953097692288:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1789048619.123601:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2ad38850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+23:11319:x1875953097692288:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 584us (945us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1789048619.123610:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:3.0:1789048619.182131:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048619.182318:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097692544 00000100:00100000:0.0:1789048619.182328:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097692544 00000100:00100000:0.0:1789048619.182481:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 98 00000100:00100000:0.0:1789048619.182491:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0884a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+23:10844:x1875953097692544:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048619.182516:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048619.182540:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c087764d0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b297f0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.182651:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764d7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.182669:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087764bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297e9 expref: 24 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.182677:0:6498:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764d7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.182730:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087764bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297e9 expref: 24 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.182745:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087764bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297e9 expref: 24 pid: 8649 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048619.182783:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1875953111408128:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789048619.182874:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c37fc09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048619.185225:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048619.185433:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1875953111408128:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048619.185463:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764d7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048619.185713:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097692672 00000100:00100000:1.0:1789048619.185722:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097692672 00010000:00010000:1.0:1789048619.185766:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087764bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297e9 expref: 25 pid: 8649 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048619.185841:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:1.0:1789048619.185853:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08848380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+25:2393:x1875953097692672:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048619.185870:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048619.185876:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087764bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297e9 expref: 25 pid: 8649 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.185888:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087764bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297e9 expref: 25 pid: 8649 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.185929:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087764bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297e9 expref: 25 pid: 8649 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.185944:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c18359600) 00010000:00010000:1.0:1789048619.185949:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764d7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.185958:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764d7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.185976:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764d7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.186005:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048619.186080:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08848380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+24:2393:x1875953097692672:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 229us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048619.186088:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 66 00010000:00010000:3.0:1789048619.186648:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764d7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.186657:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764d7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048619.186678:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789048619.186817:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c087764d0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297f0 expref: 25 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.186834:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764d7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297f0 expref: 24 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.186842:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c18359600) 00010000:00010000:3.0:1789048619.186845:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789048619.186847:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38800, rc 0) 00000100:00100000:3.0:1789048619.186898:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0884a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+24:10844:x1875953097692544:12345-192.168.202.16@tcp:101:bash.0 Request processed in 4408us (4776us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1789048619.186905:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 98 00000100:00100000:3.0:1789048619.190794:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048619.190954:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097692800 00000100:00100000:0.0:1789048619.190964:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097692800 00000100:00100000:0.0:1789048619.191046:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 99 00000100:00100000:0.0:1789048619.191179:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0884ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+24:10844:x1875953097692800:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048619.191221:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048619.191250:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087764e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b297f7 expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.191294:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c087764ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.191312:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c087764ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.191324:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c087764ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.191494:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087764e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297f7 expref: 26 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.191514:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c087764ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297f7 expref: 25 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.191529:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c18359600) 00010000:00010000:0.0:1789048619.191532:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789048619.191536:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38200, rc 0) 00000100:00100000:0.0:1789048619.191589:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0884ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+25:10844:x1875953097692800:12345-192.168.202.16@tcp:101:bash.0 Request processed in 416us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048619.191596:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 99 00000100:00100000:2.0:1789048619.196747:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048619.196849:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097693056 00000100:00100000:1.0:1789048619.196857:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097693056 00000100:00100000:1.0:1789048619.196915:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 100 00000100:00100000:1.0:1789048619.196926:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+25:10844:x1875953097693056:12345-192.168.202.16@tcp:36:bash.0 00010000:00010000:1.0:1789048619.197194:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.197212:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.197224:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789048619.197298:0:12131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967371 00000004:00010000:1.0:1789048619.197322:0:12131:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000088648e5a reply state 00000000251a2ade transno 4294967372 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.197381:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.197390:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c18359600) 00010000:00010000:1.0:1789048619.197393:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789048619.197397:0:12131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789048619.197435:0:12131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967372 00000100:00100000:1.0:1789048619.197531:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+29:10844:x1875953097693056:12345-192.168.202.16@tcp:36:bash.0 Request processed in 605us (789us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789048619.197539:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 100 00000020:00080000:1.0:1789048619.197544:0:12131:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789048619.200947:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048619.201043:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097693184 00000100:00100000:3.0:1789048619.201127:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097693184 00000100:00100000:3.0:1789048619.201226:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 101 00000100:00100000:3.0:1789048619.201237:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+29:10844:x1875953097693184:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1789048619.201261:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048619.201281:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c087764fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b297fe expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.201373:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c087764fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297fe expref: 30 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.201388:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c087764fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297fe expref: 30 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.201406:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c18359600) 00010000:00010000:3.0:1789048619.201410:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789048619.201413:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3c000, rc 0) 00000100:00100000:3.0:1789048619.201473:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+30:10844:x1875953097693184:12345-192.168.202.16@tcp:101:bash.0 Request processed in 237us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048619.201480:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 101 00000100:00100000:3.0:1789048619.205563:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048619.205674:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097693312 00000100:00100000:0.0:1789048619.205685:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097693312 00000100:00100000:0.0:1789048619.205847:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:0.0:1789048619.205858:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:10844:x1875953097693312:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048619.205878:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048619.205952:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4d002ad/0x133f221c08776501 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29805 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789048619.205989:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x18d3fa3d588fff80, atime: 0x18d3fa3ceaf315c0, ctime: 0x18d3fa3d588fff80, blocks: 0x8 00010000:00010000:0.0:1789048619.206010:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=373s v=(0 0) 00010000:00010000:0.0:1789048619.206014:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048619.206033:0:8412:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4d002ad/0x133f221c08776501 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29805 expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.206119:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e4d002ad/0x133f221c08776501 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29805 expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.206135:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39800, rc 0) 00000100:00100000:0.0:1789048619.206222:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:10844:x1875953097693312:12345-192.168.202.16@tcp:101:bash.0 Request processed in 365us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048619.206229:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:2.0:1789048619.209070:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048619.209276:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097693440 00000100:00100000:0.0:1789048619.209285:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097693440 00002000:00010000:0.0:1789048619.209370:0:8417:0:(ofd_dev.c:2841:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1789048619.209373:0:8417:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b083b0a80 with x1875953097693440 ext(0->18446744073709551615) 00002000:00010000:0.0:1789048619.209383:0:8417:0:(ofd_dev.c:2846:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff959b083b0a80. 00000100:00100000:0.0:1789048619.209407:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:0.0:1789048619.209415:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2394:x1875953097693440:12345-192.168.202.16@tcp:10:bash.0 00002000:00010000:0.0:1789048619.209629:0:8417:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789048619.209631:0:8417:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789048618382000000 -> 1789048619809000000 00002000:00010000:0.0:1789048619.209633:0:8417:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1789048616543000000 -> 1789048616543000000 00002000:00010000:0.0:1789048619.209635:0:8417:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789048618382000000 -> 1789048619809000000 00002000:00010000:0.0:1789048619.209636:0:8417:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1789048619.209685:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2394:x1875953097693440:12345-192.168.202.16@tcp:10:bash.0 Request processed in 271us (627us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789048619.209690:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00002000:00010000:0.0:1789048619.209692:0:8417:0:(ofd_dev.c:2841:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1789048619.209694:0:8417:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b083b0a80 with x1875953097693440 ext(0->18446744073709551615) 00002000:00010000:0.0:1789048619.209703:0:8417:0:(ofd_dev.c:2846:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff959b083b0a80. 00000100:00100000:2.0:1789048619.317855:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048619.318068:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097693568 00000100:00100000:3.0:1789048619.318078:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097693568 00000100:00100000:3.0:1789048619.318152:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 102 00000100:00100000:3.0:1789048619.318163:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+30:11333:x1875953097693568:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:3.0:1789048619.318247:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776508 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318268:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776508 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318284:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776508 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318315:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c0877650f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318323:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c0877650f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318373:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c0877650f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318452:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776516 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318461:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776516 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318468:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776516 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789048619.318516:0:6499:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776516 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318527:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776508 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318539:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776508 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318546:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776508 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318552:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048619.318556:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776508 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318563:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776508 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318575:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:3.0:1789048619.318578:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048619.318583:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776508 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318589:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776508 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318603:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c0877650f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318609:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c0877650f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318615:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c0877650f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318620:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3ca00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048619.318630:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c0877650f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318636:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c0877650f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318643:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c14162400) 00010000:00010000:3.0:1789048619.318646:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048619.318648:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c0877650f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318654:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c0877650f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318669:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776516 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318675:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776516 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318681:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776516 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318686:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3de00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048619.318689:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776516 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318695:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776516 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318716:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c18359600) 00010000:00010000:3.0:1789048619.318718:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048619.318727:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776516 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.318733:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776516 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048619.318822:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+30:11333:x1875953097693568:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 659us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048619.318831:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 102 00000100:00100000:3.0:1789048619.369408:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048619.369524:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097693824 00000100:00100000:2.0:1789048619.369534:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097693824 00000100:00100000:2.0:1789048619.369596:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 103 00000100:00100000:2.0:1789048619.369607:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+30:11336:x1875953097693824:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048619.369628:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048619.369653:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c0877651d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2980c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.369740:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776524 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.369771:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776524 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.369783:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776524 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.369798:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c0877652b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.369805:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c0877652b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.369811:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c0877652b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.369917:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776532 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.369926:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776532 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.369933:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776532 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048619.369943:0:6497:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789048619.370032:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776524 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.370050:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776524 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.370058:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776524 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.370072:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048619.370076:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776524 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.370084:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776524 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.370097:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:2.0:1789048619.370100:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048619.370104:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776524 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.370111:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776524 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.370124:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c0877652b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.370130:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c0877652b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.370136:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c0877652b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.370142:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048619.370145:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c0877652b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.370151:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c0877652b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.370170:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c02b11600) 00010000:00010000:2.0:1789048619.370172:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048619.370176:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c0877652b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.370182:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c0877652b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.370223:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c0877651d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2980c expref: 33 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.370237:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776532 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2980c expref: 32 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.370245:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c18359600) 00010000:00010000:2.0:1789048619.370248:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789048619.370250:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb0a00, rc 0) 00000100:00100000:2.0:1789048619.370317:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+32:11336:x1875953097693824:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 712us (920us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1789048619.370324:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 103 00000100:00100000:2.0:1789048619.376033:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048619.376159:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097693952 00000100:00100000:3.0:1789048619.376170:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097693952 00000100:00100000:3.0:1789048619.376240:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 104 00000100:00100000:3.0:1789048619.376251:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+32:11336:x1875953097693952:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:3.0:1789048619.376322:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776540 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.376371:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764d7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297f0 expref: 32 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.376383:0:6498:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776540 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.376419:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764d7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297f0 expref: 32 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.376433:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764d7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297f0 expref: 32 pid: 6498 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048619.376447:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0884b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1875953111408256:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048619.376668:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c01456540 going to sleep for 11 seconds 00000100:00100000:3.0:1789048619.379385:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048619.379442:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097694208 00000100:00100000:2.0:1789048619.379451:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097694208 00000100:00100000:0.0:1789048619.379502:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0884b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1875953111408256:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048619.379535:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776540 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048619.379571:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:2.0:1789048619.379581:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+33:6166:x1875953097694208:12345-192.168.202.16@tcp:35:ldlm_bl.0 00000001:00080000:2.0:1789048619.379811:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967375 00000100:00100000:2.0:1789048619.379906:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+35:6166:x1875953097694208:12345-192.168.202.16@tcp:35:ldlm_bl.0 Request processed in 326us (528us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789048619.379924:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000020:00080000:2.0:1789048619.379929:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789048619.381701:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048619.381806:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097694336 00000100:00100000:1.0:1789048619.381814:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097694336 00010000:00010000:1.0:1789048619.381850:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764d7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297f0 expref: 35 pid: 6498 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048619.381888:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:1.0:1789048619.381898:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+35:2393:x1875953097694336:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048619.381912:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048619.381919:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764d7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297f0 expref: 35 pid: 6498 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.381931:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764d7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297f0 expref: 35 pid: 6498 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.381976:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087764d7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b297f0 expref: 35 pid: 6498 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.381993:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c18359600) 00010000:00010000:1.0:1789048619.381998:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776540 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.382008:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776540 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.382016:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776540 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.382048:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789048619.382167:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776540 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.382198:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776540 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.382240:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776540 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.382248:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776540 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.382254:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776540 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.382260:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3de00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048619.382264:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776540 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.382271:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776540 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.382281:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c18359600) 00010000:00010000:0.0:1789048619.382283:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789048619.382286:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776540 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.382292:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776540 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048619.382391:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+34:2393:x1875953097694336:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 493us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048619.382400:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:0.0:1789048619.382689:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+33:11336:x1875953097693952:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 6439us (6674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048619.382698:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 104 00000100:00100000:3.0:1789048619.386744:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048619.386816:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097694592 00000100:00100000:1.0:1789048619.386826:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097694592 00000100:00100000:1.0:1789048619.386877:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:1.0:1789048619.386884:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+33:11336:x1875953097694592:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1789048619.387316:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+34:11336:x1875953097694592:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 294us (445us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789048619.387325:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:3.0:1789048619.454432:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048619.454554:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097694848 00000100:00100000:1.0:1789048619.454562:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097694848 00000100:00100000:1.0:1789048619.454612:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 105 00000100:00100000:1.0:1789048619.454631:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+34:11347:x1875953097694848:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:1.0:1789048619.454652:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048619.454678:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776547 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29813 expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.454742:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c0877654e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.454756:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c0877654e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.454768:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c0877654e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.454779:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08776555 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.454784:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08776555 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.454788:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08776555 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.454883:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c0877655c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.454889:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c0877655c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.454893:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c0877655c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048619.454908:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789048619.455173:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c0877654e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.455244:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c0877654e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.455250:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c0877654e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.455256:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048619.455260:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c0877654e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.455267:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c0877654e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.455278:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:1.0:1789048619.455282:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048619.455286:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c0877654e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.455291:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c0877654e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.455304:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08776555 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.455310:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08776555 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.455326:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08776555 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.455372:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048619.455374:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08776555 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.455379:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08776555 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.455385:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c3ef48700) 00010000:00010000:1.0:1789048619.455387:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048619.455389:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08776555 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.455392:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08776555 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.455428:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776547 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29813 expref: 37 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.455437:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c0877655c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29813 expref: 36 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.455442:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c18359600) 00010000:00010000:1.0:1789048619.455443:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789048619.455445:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0e00, rc 0) 00000100:00100000:1.0:1789048619.455496:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+36:11347:x1875953097694848:12345-192.168.202.16@tcp:101:cat.0 Request processed in 865us (1073us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789048619.455507:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 105 00000100:00100000:3.0:1789048619.460767:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048619.460852:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097695104 00000100:00100000:1.0:1789048619.460861:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097695104 00000100:00100000:1.0:1789048619.460939:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:1.0:1789048619.460947:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+36:11347:x1875953097695104:12345-192.168.202.16@tcp:35:cat.0 00000100:00100000:1.0:1789048619.461709:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+37:11347:x1875953097695104:12345-192.168.202.16@tcp:35:cat.0 Request processed in 755us (947us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1789048619.461719:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:3.0:1789048619.478547:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048619.478771:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097695360 00000100:00100000:2.0:1789048619.478782:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097695360 00000100:00100000:2.0:1789048619.478840:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 106 00000100:00100000:2.0:1789048619.478850:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0884bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+37:11348:x1875953097695360:12345-192.168.202.16@tcp:36:rm.0 00010000:00010000:2.0:1789048619.478907:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789048619.478931:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c087764fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297fe expref: 37 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.478948:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c0877655c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29813 expref: 36 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.478957:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776532 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2980c expref: 35 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.478977:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c087764ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297f7 expref: 34 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.478988:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c18359600) 00010000:00010000:2.0:1789048619.478993:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789048619.479014:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c0877656a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.479029:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c0877656a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.479193:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c0877656a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.479209:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776571 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.479217:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776571 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.479224:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776571 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.479300:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776578 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.479308:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776578 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.479315:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776578 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789048619.481800:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00010000:00010000:2.0:1789048619.481853:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877657f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.481865:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877657f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.481873:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877657f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.481880:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877657f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.481895:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877657f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.481899:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877657f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.481916:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048619.481939:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776578 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.481944:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776578 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.481950:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776578 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.481956:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048619.481961:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048619.481961:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776578 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.481979:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776578 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.481983:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877657f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.481989:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0000 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048619.481990:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c18359600) 00010000:00010000:2.0:1789048619.481993:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789048619.481997:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776578 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.481998:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877657f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.482004:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1a00/0x133f221c08776578 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.482005:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877657f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.482013:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c18359600) 00010000:00010000:3.0:1789048619.482015:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789048619.482018:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877657f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.482023:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c0877657f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.482030:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c0877656a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.482032:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048619.482041:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048619.482043:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048619.482050:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c0877656a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.482056:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c0877656a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.482061:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048619.482064:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c0877656a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.482070:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c0877656a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.482079:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:2.0:1789048619.482081:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048619.482084:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c0877656a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.482090:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c0877656a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789048619.482099:0:6497:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000017ed09aa reply state 0000000002c67943 transno 4294967380 ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776571 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.482110:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776571 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.482114:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c02b11600) 00010000:00010000:2.0:1789048619.482116:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789048619.482118:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789048619.482208:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0884bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+35:11348:x1875953097695360:12345-192.168.202.16@tcp:36:rm.0 Request processed in 3356us (3666us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1789048619.482222:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 106 00000100:00100000:2.0:1789048619.485573:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111408384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048619.485647:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048619.485796:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111408384 00000100:00100000:1.0:1789048619.485805:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111408384 00000100:00100000:1.0:1789048619.485865:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789048619.485876:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111408384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789048619.485898:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1789048619.487275:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111408512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048619.487324:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048619.487421:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111408512 00000100:00100000:3.0:1789048619.487427:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111408512 00000100:00100000:3.0:1789048619.487461:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789048619.487469:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111408512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789048619.487487:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1789048619.487524:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111408512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048619.487531:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789048619.487577:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111408512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789048619.488146:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111408384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2270us (2496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048619.488153:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789048619.489446:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111408384:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048619.526198:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048619.526447:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097695616 00000100:00100000:0.0:1789048619.526457:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097695616 00000100:00100000:0.0:1789048619.526521:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 107 00000100:00100000:0.0:1789048619.526530:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0884aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+35:11354:x1875953097695616:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048619.526556:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048619.526580:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776586 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2981a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.526680:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877658d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.526953:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877658d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.526980:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877658d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.527001:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776594 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.527009:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776594 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.527020:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776594 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789048619.527320:0:6498:0:(osp_object.c:1667:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1789048619.527486:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c0877659b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.527496:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c0877659b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.527515:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c0877659b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.527545:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877658d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.527551:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877658d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.527558:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877658d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.527563:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048619.527568:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877658d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.527575:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877658d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.527585:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:0.0:1789048619.527588:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048619.527592:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877658d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.527598:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877658d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789048619.527610:0:6498:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000babe6c85 reply state 00000000c9df4b17 transno 4294967381 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776594 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.527620:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776594 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.527632:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c02b11600) 00010000:00010000:0.0:1789048619.527634:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789048619.527637:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789048619.527662:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776586 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2981a expref: 38 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.527676:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c0877659b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2981a expref: 37 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.527683:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c18359c00) 00010000:00010000:0.0:1789048619.527685:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048619.527688:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38600, rc 0) 00000100:00100000:0.0:1789048619.527949:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0884aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+38:11354:x1875953097695616:12345-192.168.202.16@tcp:101:bash.0 Request processed in 1418us (1761us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1789048619.527957:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 107 00000100:00100000:3.0:1789048619.531187:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048619.531301:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097695744 00000100:00100000:1.0:1789048619.531312:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097695744 00000100:00100000:1.0:1789048619.531453:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:1.0:1789048619.531464:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0884b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2394:x1875953097695744:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1789048619.531482:0:8804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048619.531502:0:8804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dccf9e05/0x133f221c087765a9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29821 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789048619.531526:0:8804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048619.531570:0:8804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=374s v=(0 0) 00010000:00010000:1.0:1789048619.531575:0:8804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048619.531584:0:8804:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dccf9e05/0x133f221c087765a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29821 expref: 8 pid: 8804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.531603:0:8804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dccf9e05/0x133f221c087765a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29821 expref: 8 pid: 8804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.531616:0:8804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0a00, rc 0) 00000100:00100000:1.0:1789048619.531674:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0884b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2394:x1875953097695744:12345-192.168.202.16@tcp:101:bash.0 Request processed in 213us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048619.531681:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00080000:3.0:1789048619.532211:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789048619.533258:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048619.533326:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097695872 00000100:00100000:0.0:1789048619.533413:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097695872 00000100:00100000:0.0:1789048619.533453:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:0.0:1789048619.533459:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:11354:x1875953097695872:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048619.533470:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048619.533483:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c087765b0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29828 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.533503:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dccf9e05/0x133f221c087765a9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29821 expref: 9 pid: 8804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.533518:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048619.533521:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048619.533524:0:8413:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c087765b0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29828 expref: 9 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.533549:0:8413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dccf9e05/0x133f221c087765a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29821 expref: 9 pid: 8804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048619.533559:0:8413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dccf9e05/0x133f221c087765a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29821 expref: 9 pid: 8804 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048619.533569:0:8413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1875953111408640:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789048619.533686:0:8413:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b07b08840 going to sleep for 11 seconds 00000100:00100000:0.0:1789048619.536399:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048619.536721:0:8413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1875953111408640:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048619.536757:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c087765b0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b29828 expref: 9 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.536778:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39000, rc 0) 00000100:00100000:3.0:1789048619.536845:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:11354:x1875953097695872:12345-192.168.202.16@tcp:101:bash.0 Request processed in 3384us (3591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048619.536854:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:1.0:1789048619.536945:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097696000 00000100:00100000:1.0:1789048619.536953:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097696000 00010000:00010000:1.0:1789048619.537005:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dccf9e05/0x133f221c087765a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29821 expref: 9 pid: 8804 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048619.537055:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:1.0:1789048619.537064:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:2394:x1875953097696000:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048619.537077:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048619.537097:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dccf9e05/0x133f221c087765a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29821 expref: 9 pid: 8804 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.537109:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dccf9e05/0x133f221c087765a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29821 expref: 9 pid: 8804 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.537151:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dccf9e05/0x133f221c087765a9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29821 expref: 9 pid: 8804 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.537165:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048619.537169:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048619.537177:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c087765b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b29828 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.537187:0:6482:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c087765b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b29828 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.537220:0:6482:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c087765b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b29828 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048619.537234:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fccf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6482:1875953111408768:192.168.202.16@tcp:105: 00000100:00100000:1.0:1789048619.537284:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c012543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048619.540584:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fccf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6482:1875953111408768:192.168.202.16@tcp:105: 00010000:00010000:1.0:1789048619.540611:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048619.540735:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2394:x1875953097696000:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3672us (4343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048619.540744:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:0.0:1789048619.541391:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048619.541473:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097696256 00000100:00100000:1.0:1789048619.541480:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097696256 00000100:00100000:1.0:1789048619.541512:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:1.0:1789048619.541531:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+38:11354:x1875953097696256:12345-192.168.202.16@tcp:35:bash.0 00000001:00080000:1.0:1789048619.541768:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000100:00100000:1.0:1789048619.541848:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+40:11354:x1875953097696256:12345-192.168.202.16@tcp:35:bash.0 Request processed in 317us (458us total) trans 4294967383 rc 0/0 00000100:00100000:1.0:1789048619.541853:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000020:00080000:1.0:1789048619.541856:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789048619.688819:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048619.688944:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097696384 00000100:00100000:1.0:1789048619.688954:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097696384 00000100:00100000:1.0:1789048619.689050:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 108 00000100:00100000:1.0:1789048619.689062:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+40:11370:x1875953097696384:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789048619.689090:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048619.689113:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087765b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2982f expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.689187:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087765be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.689203:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087765be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.689215:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087765be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048619.689264:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789048619.689268:0:12131:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789048619.689289:0:12131:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087765be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.689313:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087765b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2982f expref: 42 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.689385:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087765be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2982f expref: 41 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.689394:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:1.0:1789048619.689397:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789048619.689401:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1800, rc 0) 00000100:00100000:1.0:1789048619.689459:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+41:11370:x1875953097696384:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 400us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048619.689466:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 108 00000100:00100000:2.0:1789048619.698887:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048619.699002:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097696640 00000100:00100000:1.0:1789048619.699012:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097696640 00000100:00100000:1.0:1789048619.699075:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 109 00000100:00100000:1.0:1789048619.699085:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+41:11370:x1875953097696640:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789048619.699114:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048619.699139:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087765c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29836 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.699258:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087765cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.699274:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087765cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.699287:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087765cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048619.699300:0:6497:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789048619.699479:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087765c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29836 expref: 44 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.699500:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087765cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29836 expref: 43 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.699509:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c18359c00) 00010000:00010000:1.0:1789048619.699511:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789048619.699515:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0400, rc 0) 00000100:00100000:1.0:1789048619.699588:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+43:11370:x1875953097696640:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 505us (710us total) trans 4294967384 rc 0/0 00000100:00100000:1.0:1789048619.699596:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 109 00000100:00100000:0.0:1789048619.707681:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048619.707732:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048619.707794:0:13167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097697024 00000100:00100000:1.0:1789048619.707805:0:13167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097697024 00000100:00100000:1.0:1789048619.707878:0:13167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:1.0:1789048619.707889:0:13167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c07cebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+43:2393:x1875953097697024:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048619.707905:0:13167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048619.707928:0:13167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087765cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29836 expref: 43 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.707944:0:13167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c18359c00) 00010000:00010000:1.0:1789048619.707948:0:13167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048619.708026:0:13167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c07cebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+42:2393:x1875953097697024:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 139us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048619.708034:0:13167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:3.0:1789048619.708167:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097696896 00000100:00100000:3.0:1789048619.708173:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097696896 00000100:00100000:3.0:1789048619.708212:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 110 00000100:00100000:3.0:1789048619.708220:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+42:11370:x1875953097696896:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789048619.708239:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048619.708270:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c087765da lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2983d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.708391:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087765e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.708406:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087765e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.708417:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087765e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048619.708429:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789048619.708538:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c087765da lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2983d expref: 45 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.708553:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087765e1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2983d expref: 44 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.708562:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c18359c00) 00010000:00010000:3.0:1789048619.708565:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789048619.708567:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3d800, rc 0) 00000100:00100000:3.0:1789048619.708609:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+44:11370:x1875953097696896:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 390us (939us total) trans 4294967385 rc 0/0 00000100:00100000:3.0:1789048619.708616:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 110 00000100:00100000:0.0:1789048619.714452:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048619.715109:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097697152 00000100:00100000:1.0:1789048619.715120:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097697152 00000100:00100000:1.0:1789048619.715246:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:1.0:1789048619.715258:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2394:x1875953097697152:12345-192.168.202.16@tcp:1:lfs.0 00010000:00010000:1.0:1789048619.715313:0:8804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d97d8ae1/0x133f221c087765ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.715363:0:8804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c087765b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b29828 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.715373:0:8804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048619.715377:0:8804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789048619.715382:0:8804:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d97d8ae1/0x133f221c087765ef lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.715425:0:8804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c087765b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29828 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.715441:0:8804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c087765b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29828 expref: 8 pid: 8413 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048619.715458:0:8804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fccc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8804:1875953111408896:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789048619.715555:0:8804:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c42f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789048619.719236:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048619.719377:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097697280 00000100:00100000:3.0:1789048619.719387:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097697280 00002000:00100000:3.0:1789048619.719439:0:8419:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff959b083b3800 x1875953097697280/t0(0) o4->85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp:630/0 lens 504/0 e 0 to 0 dl 1789048630 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789048619.719450:0:8419:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b083b3800 with x1875953097697280 ext(0->8) 00010000:00010000:3.0:1789048619.719477:0:8419:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c087765b0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29828 expref: 9 pid: 8413 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.719493:0:8419:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c087765b0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29828 expref: 9 pid: 8413 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789048619.719502:0:8419:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff959b083b3800 00000100:00100000:3.0:1789048619.719524:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:3.0:1789048619.719533:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:2393:x1875953097697280:12345-192.168.202.16@tcp:4:lfs.0 00000100:00100000:1.0:1789048619.720215:0:8804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fccc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8804:1875953111408896:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789048619.720241:0:8804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d97d8ae1/0x133f221c087765ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048619.720634:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+11:2393:x1875953097697280:12345-192.168.202.16@tcp:4:lfs.0 Request processed in 1099us (1406us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789048619.720642:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00002000:00100000:3.0:1789048619.720651:0:8419:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff959b083b3800 x1875953097697280/t4294967303(0) o4->85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp:630/0 lens 504/448 e 0 to 0 dl 1789048630 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789048619.720667:0:8419:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b083b3800 with x1875953097697280 ext(0->8) 00010000:00010000:3.0:1789048619.720673:0:8419:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c087765b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29828 expref: 11 pid: 8413 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.720686:0:8419:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c087765b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29828 expref: 11 pid: 8413 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789048619.720693:0:8419:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff959b083b3800 00000100:00100000:0.0:1789048619.723434:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048619.723509:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097697408 00000100:00100000:3.0:1789048619.723518:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097697408 00010000:00010000:3.0:1789048619.723560:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c087765b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29828 expref: 11 pid: 8413 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048619.723623:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:3.0:1789048619.723633:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+11:2391:x1875953097697408:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048619.723651:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789048619.723677:0:6481:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789048619.723681:0:6481:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789048620154503337 00002000:00010000:3.0:1789048619.723683:0:6481:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789048620325647607 00002000:00010000:3.0:1789048619.723686:0:6481:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789048620154503337 00002000:00010000:3.0:1789048619.723689:0:6481:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789048619.723696:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c087765b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29828 expref: 11 pid: 8413 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.723711:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c087765b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29828 expref: 11 pid: 8413 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.723733:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c087765b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29828 expref: 11 pid: 8413 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.723750:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789048619.723754:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789048619.723760:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d97d8ae1/0x133f221c087765ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.723769:0:6481:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d97d8ae1/0x133f221c087765ef lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.723820:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789048619.723850:0:8804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d97d8ae1/0x133f221c087765ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048619.723864:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+10:2391:x1875953097697408:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 231us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048619.723877:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 69 00010000:00010000:1.0:1789048619.723878:0:8804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d97d8ae1/0x133f221c087765ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.723902:0:8804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d97d8ae1/0x133f221c087765ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.723911:0:8804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d97d8ae1/0x133f221c087765ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.723918:0:8804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d97d8ae1/0x133f221c087765ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.723924:0:8804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0400 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048619.723928:0:8804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d97d8ae1/0x133f221c087765ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.723936:0:8804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d97d8ae1/0x133f221c087765ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.723948:0:8804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d97d8ae1/0x133f221c087765ef lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.723955:0:8804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d97d8ae1/0x133f221c087765ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048619.724043:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:2394:x1875953097697152:12345-192.168.202.16@tcp:1:lfs.0 Request processed in 8771us (9695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048619.724052:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:0.0:1789048619.730410:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048619.730461:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097697664 00000100:00100000:1.0:1789048619.730472:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097697664 00000100:00100000:1.0:1789048619.730579:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:1.0:1789048619.730589:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2ad3b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+44:11370:x1875953097697664:12345-192.168.202.16@tcp:35:lfs.0 00000004:00010000:1.0:1789048619.730666:0:6500:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087765e1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2983d expref: 44 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789048619.730854:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:1.0:1789048619.730879:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000001:00080000:1.0:1789048619.731236:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1789048619.731272:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087765f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.731288:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c0877659b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2981a expref: 48 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.731298:0:6500:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087765f6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.731374:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c0877659b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2981a expref: 48 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.731389:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c0877659b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2981a expref: 48 pid: 6498 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048619.731418:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fccc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6500:1875953111409024:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789048619.731496:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c42f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789048619.735807:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fccc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6500:1875953111409024:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789048619.735835:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087765f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048619.736403:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048619.736808:0:13167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097697792 00000100:00100000:1.0:1789048619.736817:0:13167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097697792 00010000:00010000:1.0:1789048619.736857:0:13167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c0877659b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2981a expref: 49 pid: 6498 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048619.736902:0:13167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:1.0:1789048619.736912:0:13167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+49:2393:x1875953097697792:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048619.736928:0:13167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048619.736934:0:13167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c0877659b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2981a expref: 49 pid: 6498 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.736945:0:13167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c0877659b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2981a expref: 49 pid: 6498 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.736978:0:13167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c0877659b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2981a expref: 49 pid: 6498 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.736993:0:13167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c18359c00) 00010000:00010000:1.0:1789048619.736998:0:13167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087765f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.737020:0:13167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087765f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.737026:0:13167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087765f6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.737057:0:13167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789048619.737110:0:6500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087765f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048619.737111:0:13167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+48:2393:x1875953097697792:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 199us (708us total) trans 0 rc 0/0 00010000:00010000:3.0:1789048619.737119:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087765f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048619.737119:0:13167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 70 00000001:00080000:3.0:1789048619.737255:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00000001:00080000:3.0:1789048619.737410:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00000100:00100000:3.0:1789048619.737514:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08887480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1875953111409152:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789048619.737589:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048619.737619:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c05d31000 going to sleep for 11 seconds 00000100:00100000:0.0:1789048619.737772:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111409152 00000100:00100000:0.0:1789048619.737778:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111409152 00000100:00100000:0.0:1789048619.737833:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789048619.737841:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6500:x1875953111409152:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789048619.737947:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6500:x1875953111409152:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 107us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048619.737954:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789048619.738037:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08887480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1875953111409152:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789048619.738151:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967391 00000100:00100000:3.0:1789048619.738194:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08887480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1875953111409280:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789048619.738220:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048619.738255:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c012543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048619.738280:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111409280 00000100:00100000:0.0:1789048619.738284:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111409280 00000100:00100000:0.0:1789048619.738315:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789048619.738323:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6500:x1875953111409280:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789048619.738548:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6500:x1875953111409280:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 225us (326us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789048619.738555:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789048619.738815:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08887480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1875953111409280:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789048619.738853:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967392 00010000:00010000:3.0:1789048619.738882:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087765f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.738891:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087765f6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.738908:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087765f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.738914:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048619.738918:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087765f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.738926:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087765f6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.738939:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c18359c00) 00010000:00010000:3.0:1789048619.738942:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789048619.738946:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087765f6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048619.738952:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087765f6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789048619.739052:0:6500:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789048619.739253:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1789048619.739266:0:6500:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 374492932097ns, next at 375492929366ns, rc = 0 00000001:00080000:3.0:1789048619.739272:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00010000:00010000:3.0:1789048619.739365:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c18359c00) 00010000:00010000:3.0:1789048619.739369:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789048619.739375:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087765e1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2983d expref: 52 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048619.739464:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2ad3b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+51:11370:x1875953097697664:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 8876us (9064us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789048619.739476:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 26 00000020:00080000:3.0:1789048619.739479:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789048619.742441:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048619.743014:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097697920 00000100:00100000:2.0:1789048619.743024:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097697920 00000100:00100000:2.0:1789048619.743086:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 111 00000100:00100000:2.0:1789048619.743097:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+51:11370:x1875953097697920:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048619.743121:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048619.743144:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c087765fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29844 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.743212:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c087765fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29844 expref: 52 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.743227:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c087765fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29844 expref: 52 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048619.743248:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:2.0:1789048619.743251:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789048619.743254:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb0600, rc 0) 00000100:00100000:2.0:1789048619.743314:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+52:11370:x1875953097697920:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 218us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048619.743377:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 111 00000100:00100000:2.0:1789048619.749009:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048619.750715:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097698176 00000100:00100000:1.0:1789048619.750731:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097698176 00000100:00100000:1.0:1789048619.750943:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:1.0:1789048619.750956:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+52:11370:x1875953097698176:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1789048619.751596:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+53:11370:x1875953097698176:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 376us (2329us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1789048619.751607:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:0.0:1789048619.845072:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048619.845308:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097698304 00000100:00100000:1.0:1789048619.845319:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097698304 00000100:00100000:1.0:1789048619.845416:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 112 00000100:00100000:1.0:1789048619.845425:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+53:11380:x1875953097698304:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:1.0:1789048619.845507:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776604 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845525:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776604 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845537:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776604 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845568:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877660b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845576:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877660b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845582:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877660b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845658:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776612 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845677:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776612 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845684:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776612 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789048619.845735:0:6497:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776612 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845749:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776604 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845755:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776604 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845762:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776604 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845769:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048619.845773:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776604 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845797:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776604 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845811:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:1.0:1789048619.845814:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048619.845819:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776604 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845826:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776604 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845841:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877660b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845847:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877660b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845852:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877660b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845858:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048619.845861:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877660b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845867:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877660b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845874:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c02b11600) 00010000:00010000:1.0:1789048619.845876:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048619.845878:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877660b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845893:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877660b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845904:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776612 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845909:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776612 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845914:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776612 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845918:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048619.845921:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776612 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845926:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776612 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845946:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:1.0:1789048619.845949:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048619.845952:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776612 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.845958:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776612 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048619.846049:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+53:11380:x1875953097698304:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 624us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048619.846058:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 112 00000100:00100000:0.0:1789048619.903558:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048619.904005:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097698560 00000100:00100000:1.0:1789048619.904016:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097698560 00000100:00100000:1.0:1789048619.904085:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 113 00000100:00100000:1.0:1789048619.904104:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+53:11383:x1875953097698560:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789048619.904128:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048619.904151:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776619 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2984b expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904229:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776620 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904246:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776620 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904258:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776620 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904269:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776627 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904276:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776627 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904284:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776627 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904428:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c0877662e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904438:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c0877662e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904463:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c0877662e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048619.904475:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789048619.904548:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776620 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904557:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776620 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904564:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776620 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904571:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048619.904576:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776620 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904583:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776620 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904595:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:1.0:1789048619.904611:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048619.904616:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776620 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904622:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776620 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904635:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776627 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904642:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776627 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904668:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776627 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904674:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048619.904678:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776627 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904685:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776627 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904693:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c02b11600) 00010000:00010000:1.0:1789048619.904696:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048619.904699:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776627 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904704:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776627 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904739:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776619 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2984b expref: 56 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904751:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c0877662e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2984b expref: 55 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.904757:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:1.0:1789048619.904759:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789048619.904761:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1e00, rc 0) 00000100:00100000:1.0:1789048619.904983:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+55:11383:x1875953097698560:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 880us (1435us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1789048619.904999:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 113 00000100:00100000:2.0:1789048619.916856:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048619.917114:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097698688 00000100:00100000:1.0:1789048619.917127:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097698688 00000100:00100000:1.0:1789048619.917190:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 114 00000100:00100000:1.0:1789048619.917203:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+55:11383:x1875953097698688:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:1.0:1789048619.917272:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877663c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.917288:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877663c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.917300:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877663c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.917363:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877663c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.917371:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877663c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.917377:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877663c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.917383:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048619.917389:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877663c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.917396:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877663c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.917406:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:1.0:1789048619.917424:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789048619.917430:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877663c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048619.917437:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c0877663c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048619.917509:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+55:11383:x1875953097698688:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 309us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048619.917517:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 114 00000100:00100000:2.0:1789048619.924602:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048619.924816:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097698944 00000100:00100000:3.0:1789048619.924826:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097698944 00000100:00100000:3.0:1789048619.924882:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:3.0:1789048619.924893:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+55:11383:x1875953097698944:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1789048619.925155:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+56:11383:x1875953097698944:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 263us (565us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1789048619.925162:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 28 00010000:00010000:1.0:1789048619.997675:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048620.033115:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048620.033806:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097699200 00000100:00100000:1.0:1789048620.033817:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097699200 00000100:00100000:1.0:1789048620.033880:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 115 00000100:00100000:1.0:1789048620.033888:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+56:11393:x1875953097699200:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1789048620.033911:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048620.033914:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789048620.033939:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087765be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2982f expref: 56 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.033955:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:1.0:1789048620.033969:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789048620.033983:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776643 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29852 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.034089:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c0877664a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.034103:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c0877664a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.034126:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c0877664a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048620.034138:0:6497:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789048620.034235:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776643 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29852 expref: 58 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.038782:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c0877664a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29852 expref: 57 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.038795:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:1.0:1789048620.038798:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789048620.038802:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0400, rc 0) 00000100:00100000:1.0:1789048620.038907:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+57:11393:x1875953097699200:12345-192.168.202.16@tcp:101:bash.0 Request processed in 5017us (5803us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1789048620.038918:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 115 00000100:00100000:2.0:1789048620.043077:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048620.043182:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097699328 00000100:00100000:0.0:1789048620.043194:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097699328 00000100:00100000:0.0:1789048620.043257:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 116 00000100:00100000:0.0:1789048620.043270:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+57:11393:x1875953097699328:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048620.043297:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048620.043321:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776658 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29859 expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048620.043416:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877665f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048620.043444:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877665f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048620.043471:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877665f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048620.043596:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776658 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29859 expref: 59 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048620.043614:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877665f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29859 expref: 58 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048620.043621:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:0.0:1789048620.043624:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789048620.043627:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39000, rc 0) 00000100:00100000:0.0:1789048620.043683:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+58:11393:x1875953097699328:12345-192.168.202.16@tcp:101:bash.0 Request processed in 416us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048620.043690:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 116 00000100:00100000:0.0:1789048620.047136:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048620.047228:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097699456 00000100:00100000:1.0:1789048620.047239:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097699456 00000100:00100000:1.0:1789048620.047913:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:1.0:1789048620.047928:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+58:2391:x1875953097699456:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048620.047948:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048620.047984:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c0877664a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29852 expref: 58 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.048003:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:1.0:1789048620.048007:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048620.048079:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+57:2391:x1875953097699456:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 155us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048620.048087:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:2.0:1789048620.050763:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048620.050956:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097699712 00000100:00100000:1.0:1789048620.050973:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097699712 00000100:00100000:1.0:1789048620.051029:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 117 00000100:00100000:1.0:1789048620.051040:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+57:11393:x1875953097699712:12345-192.168.202.16@tcp:36:bash.0 00010000:00010000:1.0:1789048620.051122:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048620.051150:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c0877662e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2984b expref: 57 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.051165:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:1.0:1789048620.051169:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789048620.051329:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776666 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.051387:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776666 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.051397:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776666 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789048620.051446:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967399 00000004:00010000:1.0:1789048620.051464:0:6499:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000019514a2b reply state 000000005f4b9a44 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776666 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.051473:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776666 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.051487:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:1.0:1789048620.051496:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789048620.051500:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789048620.051849:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+59:11393:x1875953097699712:12345-192.168.202.16@tcp:36:bash.0 Request processed in 810us (1098us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789048620.051855:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 117 00000020:00080000:1.0:1789048620.051859:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789048620.056171:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048620.056230:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097699840 00000100:00100000:1.0:1789048620.056238:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097699840 00000100:00100000:1.0:1789048620.056287:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:1.0:1789048620.056298:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+59:11393:x1875953097699840:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1789048620.056320:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048620.056366:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877666d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29860 expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.056471:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776674 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.056497:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776674 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.056510:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776674 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048620.056599:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789048620.056603:0:12131:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789048620.056620:0:12131:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776674 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.056646:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877666d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29860 expref: 61 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.056684:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776674 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29860 expref: 60 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.056692:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:1.0:1789048620.056695:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789048620.056699:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1c00, rc 0) 00000100:00100000:1.0:1789048620.056800:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+60:11393:x1875953097699840:12345-192.168.202.16@tcp:101:bash.0 Request processed in 503us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048620.056808:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:0.0:1789048620.060801:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048620.060950:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097700096 00000100:00100000:3.0:1789048620.060968:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097700096 00000100:00100000:3.0:1789048620.061019:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:3.0:1789048620.061029:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+60:11393:x1875953097700096:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:3.0:1789048620.061238:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+61:11393:x1875953097700096:12345-192.168.202.16@tcp:35:bash.0 Request processed in 212us (449us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789048620.061244:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:2.0:1789048620.138089:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048620.138199:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097700224 00000100:00100000:3.0:1789048620.138210:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097700224 00000100:00100000:3.0:1789048620.138278:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 119 00000100:00100000:3.0:1789048620.138288:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+61:11399:x1875953097700224:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789048620.138313:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048620.138369:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877667b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29867 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048620.138436:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776682 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048620.138464:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776682 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048620.138477:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776682 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048620.138532:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789048620.138536:0:6498:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789048620.138556:0:6498:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776682 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048620.138581:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877667b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29867 expref: 63 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048620.138600:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776682 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29867 expref: 62 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048620.138609:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:3.0:1789048620.138612:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789048620.138616:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3ca00, rc 0) 00000100:00100000:3.0:1789048620.138681:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+62:11399:x1875953097700224:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 394us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048620.138700:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 119 00000100:00100000:2.0:1789048620.147164:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048620.147455:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097700352 00000100:00100000:1.0:1789048620.147467:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097700352 00000100:00100000:1.0:1789048620.147538:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 120 00000100:00100000:1.0:1789048620.147549:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+62:11399:x1875953097700352:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789048620.147571:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048620.147593:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776689 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2986e expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.147661:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c08776690 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.147677:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c08776690 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149489:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c08776690 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149520:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776697 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149548:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149558:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149641:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c0877669e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149651:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c0877669e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149658:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c0877669e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048620.149780:0:6499:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789048620.149785:0:6499:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789048620.149805:0:6499:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c0877669e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149818:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c0877669e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149826:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c08776690 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149845:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c08776690 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149852:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c08776690 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149867:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048620.149872:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c08776690 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149879:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c08776690 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149892:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:1.0:1789048620.149895:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048620.149900:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c08776690 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149907:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c08776690 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149921:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149927:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776697 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149932:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776697 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149937:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048620.149940:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776697 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149946:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776697 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149975:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c02b11600) 00010000:00010000:1.0:1789048620.149977:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048620.149980:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776697 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.149986:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c08776697 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.150019:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776689 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2986e expref: 64 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.150035:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c0877669e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2986e expref: 63 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.150042:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:1.0:1789048620.150044:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789048620.150047:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0c00, rc 0) 00000100:00100000:1.0:1789048620.150836:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+63:11399:x1875953097700352:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 3284us (3677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048620.150848:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 120 00000100:00100000:0.0:1789048620.161869:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048620.161945:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097700608 00000100:00100000:1.0:1789048620.161955:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097700608 00000100:00100000:1.0:1789048620.162027:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 121 00000100:00100000:1.0:1789048620.162038:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+63:11399:x1875953097700608:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789048620.162059:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048620.162080:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c087766a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29875 expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.162211:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087766ac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.162226:0:12131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776674 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29860 expref: 64 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.162232:0:12131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c0877669e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2986e expref: 64 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.162237:0:12131:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087766ac lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.162264:0:12131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c0877669e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2986e expref: 64 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.162275:0:12131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c0877669e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2986e expref: 64 pid: 6499 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048620.162286:0:12131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fccc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12131:1875953111409408:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789048620.162403:0:12131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776674 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29860 expref: 64 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.162410:0:12131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776674 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29860 expref: 64 pid: 12131 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048620.162416:0:12131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fccf100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12131:1875953111409536:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789048620.162450:0:12131:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c423c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048620.166686:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048620.166863:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097700736 00000100:00100000:1.0:1789048620.166873:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097700736 00010000:00010000:1.0:1789048620.166919:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c0877669e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2986e expref: 65 pid: 6499 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048620.166973:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:1.0:1789048620.166984:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+65:2392:x1875953097700736:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048620.167001:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048620.167008:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c0877669e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2986e expref: 65 pid: 6499 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.167023:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c0877669e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2986e expref: 65 pid: 6499 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.167049:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:1.0:1789048620.167056:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087766ac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.167067:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087766ac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.167075:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048620.167134:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+65:2392:x1875953097700736:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 152us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048620.167142:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 71 00010000:00010000:1.0:1789048620.168668:0:12131:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.16@tcp) returned -22 from blocking AST (req@0000000048de0edf x1875953111409408) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c0877669e lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2986e expref: 64 pid: 6499 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.168718:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c0877669e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2986e expref: 64 pid: 6499 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048620.168734:0:12131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fccc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12131:1875953111409408:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789048620.168748:0:12131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fccf100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12131:1875953111409536:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789048620.168769:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:1.0:1789048620.168774:0:12131:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087766ac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.168782:0:12131:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087766ac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.168790:0:12131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087766ac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048620.172564:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048620.173176:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097700864 00000100:00100000:3.0:1789048620.173186:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097700864 00010000:00010000:3.0:1789048620.173231:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776674 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29860 expref: 64 pid: 12131 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048620.173278:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 72 00000100:00100000:3.0:1789048620.173311:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+64:2393:x1875953097700864:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048620.173326:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048620.173367:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776674 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29860 expref: 64 pid: 12131 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048620.173382:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776674 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29860 expref: 64 pid: 12131 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048620.173404:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776674 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29860 expref: 64 pid: 12131 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048620.173421:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:3.0:1789048620.173427:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087766ac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048620.173437:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087766ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048620.173445:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087766ac lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048620.173479:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048620.173537:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+63:2393:x1875953097700864:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 229us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048620.173545:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 72 00010000:00010000:2.0:1789048620.173788:0:12131:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087766ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.173799:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087766ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048620.173818:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789048620.173964:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c087766a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29875 expref: 64 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.173981:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087766ac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29875 expref: 63 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.173988:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:2.0:1789048620.173991:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789048620.173993:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0400, rc 0) 00000100:00100000:2.0:1789048620.174027:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+63:11399:x1875953097700608:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 11991us (12175us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1789048620.174041:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 121 00000100:00100000:2.0:1789048620.179169:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048620.179285:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097701120 00000100:00100000:1.0:1789048620.179295:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097701120 00000100:00100000:1.0:1789048620.179690:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:1.0:1789048620.179703:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+63:11399:x1875953097701120:12345-192.168.202.16@tcp:103:lfs.0 00010000:00010000:1.0:1789048620.179720:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048620.179745:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c087765fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29844 expref: 63 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.179759:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:1.0:1789048620.179763:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048620.179851:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+62:11399:x1875953097701120:12345-192.168.202.16@tcp:103:lfs.0 Request processed in 152us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048620.179856:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:2.0:1789048620.182749:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048620.182823:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097701248 00000100:00100000:1.0:1789048620.182831:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097701248 00000100:00100000:1.0:1789048620.182919:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 122 00000100:00100000:1.0:1789048620.182927:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+62:11399:x1875953097701248:12345-192.168.202.16@tcp:58:lfs.0 00010000:00010000:1.0:1789048620.183069:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087766ba lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.183088:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087766ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.183103:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087766ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789048620.183214:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1789048620.183371:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+62:11399:x1875953097701248:12345-192.168.202.16@tcp:58:lfs.0 Request processed in 443us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048620.183379:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 122 00000100:00100000:2.0:1789048620.190710:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048620.190828:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097701376 00000100:00100000:1.0:1789048620.190837:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097701376 00000100:00100000:1.0:1789048620.190919:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 123 00000100:00100000:1.0:1789048620.190927:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+62:11399:x1875953097701376:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789048620.190947:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048620.191002:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087766c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2987c expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.191057:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087766ba lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.191081:0:6499:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087766c1 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2987c expref: 63 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.191100:0:6499:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087766ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.191114:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087766c1 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2987c expref: 63 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.191128:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:1.0:1789048620.191131:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789048620.191135:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087766c1 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2987c expref: 63 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.191141:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1e00, rc 0) 00000100:00100000:1.0:1789048620.191191:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+63:11399:x1875953097701376:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 265us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048620.191196:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 123 00000100:00100000:2.0:1789048620.512068:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111409664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789048620.512145:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048620.512300:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111409664 00000100:00100000:0.0:1789048620.512309:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111409664 00000100:00100000:0.0:1789048620.512392:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789048620.512401:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111409664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789048620.512437:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789048620.525065:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111409664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 12656us (12910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048620.525079:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789048620.525285:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111409664:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1789048620.957940:0:13779:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789048620.957959:0:13779:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789048620.958005:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1789048620.958012:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789048620.958123:0:13779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fccf100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13779:1875953111409792:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789048620.958301:0:13779:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c42f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789048620.961763:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048620.965136:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097701504 00000100:00100000:3.0:1789048620.965150:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097701504 00000100:00100000:3.0:1789048620.965227:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 124 00000100:00100000:3.0:1789048620.965238:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+64:11400:x1875953097701504:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789048620.965289:0:12131:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789048620.965452:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+64:11400:x1875953097701504:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 215us (3699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048620.965465:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 124 00000100:00100000:1.0:1789048620.968825:0:13779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fccf100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13779:1875953111409792:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789048620.972636:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048620.972726:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097701632 00000100:00100000:2.0:1789048620.972736:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097701632 00000100:00100000:2.0:1789048620.972909:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 125 00000100:00100000:2.0:1789048620.972918:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+63:11400:x1875953097701632:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789048620.973015:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c087766c8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973032:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c087766c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973047:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c087766c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973064:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087766cf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973071:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087766cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973078:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087766cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973109:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c087766d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973120:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c087766d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973127:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c087766d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048620.973173:0:6497:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789048620.973177:0:6497:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789048620.973190:0:6497:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c087766d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973201:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c087766c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973207:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c087766c8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973214:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c087766c8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973220:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048620.973224:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c087766c8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973232:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c087766c8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973245:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff959c05322a00) 00010000:00010000:2.0:1789048620.973254:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048620.973259:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c087766c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973265:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c087766c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973285:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087766cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973292:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087766cf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973298:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087766cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973303:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048620.973306:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087766cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973312:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087766cf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973320:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff959c02b11100) 00010000:00010000:2.0:1789048620.973323:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048620.973326:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087766cf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973385:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087766cf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973401:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c087766d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973414:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c087766d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973420:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c087766d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973425:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048620.973428:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c087766d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973435:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c087766d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973444:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:2.0:1789048620.973446:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048620.973450:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c087766d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048620.973455:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c087766d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048620.973531:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+63:11400:x1875953097701632:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 Request processed in 611us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048620.973539:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 125 00000100:00100000:2.0:1789048620.988307:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048620.989093:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097701888 00000100:00100000:1.0:1789048620.989104:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097701888 00000100:00100000:1.0:1789048620.989228:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 126 00000100:00100000:1.0:1789048620.989238:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+63:11400:x1875953097701888:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789048620.989259:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048620.989282:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c087766dd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29883 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.989417:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087766e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.989431:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087766e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.989444:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087766e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048620.989456:0:6499:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789048620.989531:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087766e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.989538:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087766e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.989544:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087766e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.989549:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048620.989553:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087766e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.989560:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087766e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.989585:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:1.0:1789048620.989588:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789048620.989593:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087766e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.989599:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087766e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.989638:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c087766dd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29883 expref: 65 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.989647:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff959c05322a00) 00010000:00010000:1.0:1789048620.989649:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789048620.989652:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c087766dd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29883 expref: 65 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048620.989660:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0200, rc 0) 00000100:00100000:1.0:1789048620.989715:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+64:11400:x1875953097701888:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 479us (1419us total) trans 4294967403 rc 301/301 00000100:00100000:1.0:1789048620.989722:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 126 00000100:00100000:1.0:1789048620.997204:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048620.997291:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097702016 00000100:00100000:3.0:1789048620.997301:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097702016 00000100:00100000:3.0:1789048620.997389:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 127 00000100:00100000:3.0:1789048620.997400:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+64:11400:x1875953097702016:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789048620.997437:0:12131:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789048620.997550:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+64:11400:x1875953097702016:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 152us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048620.997558:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 127 00000100:00100000:2.0:1789048621.001528:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048621.002143:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097702272 00000100:00100000:1.0:1789048621.002153:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097702272 00000100:00100000:1.0:1789048621.002277:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 128 00000100:00100000:1.0:1789048621.002287:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+64:11400:x1875953097702272:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789048621.002309:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048621.002313:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789048621.002394:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776682 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29867 expref: 64 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.002419:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:1.0:1789048621.002424:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789048621.002440:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c087766f2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2988a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789048621.002831:0:6497:0:(osp_object.c:1667:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1789048621.002994:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087766f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.003018:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087766f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.003028:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087766f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.003077:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c087766f2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2988a expref: 66 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.003094:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087766f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2988a expref: 65 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.003102:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff959c3ef48700) 00010000:00010000:1.0:1789048621.003104:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789048621.003107:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0600, rc 0) 00000100:00100000:1.0:1789048621.003165:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+65:11400:x1875953097702272:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 879us (1645us total) trans 4294967404 rc 0/0 00000100:00100000:1.0:1789048621.003184:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 128 00000100:00080000:3.0:1789048621.004325:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789048621.011115:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048621.011206:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097702528 00000100:00100000:1.0:1789048621.011216:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097702528 00000100:00100000:1.0:1789048621.011317:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 129 00000100:00100000:1.0:1789048621.011328:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+65:11400:x1875953097702528:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789048621.011451:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048621.011478:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087766f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2988a expref: 65 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.011497:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff959c3ef48700) 00010000:00010000:1.0:1789048621.011508:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789048621.011530:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c08776707 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.011545:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c08776707 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.011556:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c08776707 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.011571:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877670e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xb05b7a23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.011578:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877670e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb05b7a23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.011584:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877670e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb05b7a23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.011644:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c08776707 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.011651:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c08776707 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.011658:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c08776707 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.011664:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048621.011668:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c08776707 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.011675:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c08776707 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.011684:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:1.0:1789048621.011686:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048621.011690:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c08776707 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.011695:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c08776707 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.011703:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877670e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb05b7a23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.011709:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877670e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb05b7a23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.011715:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877670e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb05b7a23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.011726:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048621.011729:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877670e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb05b7a23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.011735:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877670e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb05b7a23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.011742:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xb05b7a23 (ffff959c3ef48400) 00010000:00010000:1.0:1789048621.011744:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048621.011747:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877670e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb05b7a23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.011752:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877670e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb05b7a23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048621.011827:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+64:11400:x1875953097702528:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 502us (720us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789048621.011834:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 129 00000100:00100000:2.0:1789048621.015440:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048621.015536:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097702656 00000100:00100000:0.0:1789048621.015547:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097702656 00000100:00100000:0.0:1789048621.015601:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 130 00000100:00100000:0.0:1789048621.015611:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+64:11400:x1875953097702656:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789048621.015631:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048621.015661:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776715 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29891 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.015696:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c0877671c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.015709:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c0877671c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.015722:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c0877671c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.015830:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776715 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29891 expref: 66 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.015851:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c0877671c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29891 expref: 65 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.015860:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff959c18359b00) 00010000:00010000:0.0:1789048621.015862:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789048621.015865:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38000, rc 0) 00000100:00100000:0.0:1789048621.015926:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+65:11400:x1875953097702656:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 316us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048621.015934:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 130 00000100:00100000:2.0:1789048621.018294:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048621.018537:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097702912 00000100:00100000:0.0:1789048621.018547:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097702912 00000100:00100000:0.0:1789048621.018595:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 131 00000100:00100000:0.0:1789048621.018602:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+65:11400:x1875953097702912:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789048621.018681:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776723 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.018698:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776723 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.018710:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776723 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789048621.018848:0:8649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1789048621.018858:0:8649:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 375772523681ns, next at 376772521653ns, rc = 0 00000004:00010000:0.0:1789048621.018908:0:8649:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000055eea738 reply state 000000001c774ec6 transno 4294967405 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776723 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.018920:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776723 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.018925:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff959c18359b00) 00010000:00010000:0.0:1789048621.018927:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789048621.018931:0:8649:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789048621.019278:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+67:11400:x1875953097702912:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 674us (993us total) trans 4294967405 rc 0/0 00000100:00100000:0.0:1789048621.019286:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 131 00010000:00010000:1.0:1789048621.025476:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789048621.026671:0:9492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1789048621.026685:0:9492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1789048621.026802:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048621.026854:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097703040 00000100:00100000:1.0:1789048621.026864:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097703040 00000100:00100000:1.0:1789048621.026982:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 132 00000100:00100000:1.0:1789048621.027004:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+67:11400:x1875953097703040:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789048621.027107:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048621.027128:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877672a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29898 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.027193:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877672a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29898 expref: 68 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.027204:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877672a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29898 expref: 68 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.027218:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff959c18359b00) 00010000:00010000:0.0:1789048621.027220:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789048621.027223:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38a00, rc 0) 00000100:00100000:0.0:1789048621.027263:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+68:11400:x1875953097703040:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 272us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048621.027268:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 132 00000100:00100000:2.0:1789048621.029769:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048621.029839:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097703168 00000100:00100000:3.0:1789048621.029847:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097703168 00000100:00100000:3.0:1789048621.029921:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:3.0:1789048621.029931:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2393:x1875953097703168:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789048621.030126:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:2393:x1875953097703168:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 197us (363us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789048621.030131:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00080000:0.0:1789048621.030228:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048621.032638:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048621.032731:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097703424 00000100:00100000:1.0:1789048621.032741:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097703424 00000100:00100000:1.0:1789048621.032791:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:1.0:1789048621.032811:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+68:11400:x1875953097703424:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789048621.033115:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+69:11400:x1875953097703424:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 304us (482us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1789048621.033120:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:2.0:1789048621.035935:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048621.036137:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097703680 00000100:00100000:1.0:1789048621.036146:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097703680 00000100:00100000:1.0:1789048621.036244:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 133 00000100:00100000:1.0:1789048621.036256:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+69:11400:x1875953097703680:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789048621.036395:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+69:11400:x1875953097703680:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 141us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048621.036403:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 133 00000100:00100000:2.0:1789048621.039437:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048621.039542:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097703808 00000100:00100000:0.0:1789048621.039552:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097703808 00000100:00100000:0.0:1789048621.039651:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 134 00000100:00100000:0.0:1789048621.039662:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+69:11400:x1875953097703808:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789048621.039682:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048621.039704:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776731 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2989f expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.039771:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776738 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.039786:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776738 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.039821:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776738 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048621.039869:0:8649:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789048621.039889:0:8649:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776738 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.039916:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776731 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2989f expref: 71 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.039934:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776738 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2989f expref: 70 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.039942:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff959c18359b00) 00010000:00010000:0.0:1789048621.039945:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789048621.039958:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38200, rc 0) 00000100:00100000:0.0:1789048621.040023:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+70:11400:x1875953097703808:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 364us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048621.040029:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 134 00000100:00100000:2.0:1789048621.042851:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048621.042939:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097703936 00000100:00100000:3.0:1789048621.042959:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097703936 00000100:00100000:3.0:1789048621.043240:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:3.0:1789048621.043250:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:2394:x1875953097703936:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789048621.043268:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048621.043444:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008a1161c/0x133f221c0877673f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b298a6 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789048621.043469:0:8414:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fa3e1a37cdc0, blocks: 0x0 00010000:00010000:3.0:1789048621.043489:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=375s v=(0 0) 00010000:00010000:3.0:1789048621.043494:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048621.043503:0:8414:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008a1161c/0x133f221c0877673f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298a6 expref: 10 pid: 8414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.043519:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000008a1161c/0x133f221c0877673f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298a6 expref: 10 pid: 8414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.043531:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3d800, rc 0) 00000100:00100000:3.0:1789048621.043647:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+10:2394:x1875953097703936:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 398us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048621.043654:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:2.0:1789048621.046324:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048621.046409:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097704192 00000100:00100000:0.0:1789048621.046418:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097704192 00000100:00100000:0.0:1789048621.046478:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 135 00000100:00100000:0.0:1789048621.046488:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+70:11400:x1875953097704192:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789048621.046592:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+70:11400:x1875953097704192:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 105us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048621.046599:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 135 00000100:00100000:2.0:1789048621.048829:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048621.048913:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097704320 00000100:00100000:3.0:1789048621.048924:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097704320 00000100:00100000:3.0:1789048621.049032:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:3.0:1789048621.049041:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+10:11400:x1875953097704320:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789048621.049054:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048621.049070:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08776746 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b298ad expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.049094:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000008a1161c/0x133f221c0877673f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298a6 expref: 11 pid: 8414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.049115:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048621.049119:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048621.049122:0:8412:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08776746 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298ad expref: 11 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.049162:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000008a1161c/0x133f221c0877673f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b298a6 expref: 11 pid: 8414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.049172:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000008a1161c/0x133f221c0877673f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b298a6 expref: 11 pid: 8414 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048621.049182:0:8412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08886680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1875953111409920:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048621.049271:0:8412:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2b027cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048621.051371:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048621.051377:0:8412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08886680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1875953111409920:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048621.051409:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08776746 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b298ad expref: 11 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.051428:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3c400, rc 0) 00000100:00100000:3.0:1789048621.051479:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+11:11400:x1875953097704320:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 2439us (2659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048621.051488:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:1.0:1789048621.051616:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097704448 00000100:00100000:1.0:1789048621.051623:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097704448 00010000:00010000:1.0:1789048621.051654:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000008a1161c/0x133f221c0877673f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b298a6 expref: 11 pid: 8414 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048621.051687:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 73 00000100:00100000:1.0:1789048621.051695:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c07ceb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+11:2393:x1875953097704448:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048621.051707:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048621.051726:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000008a1161c/0x133f221c0877673f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b298a6 expref: 11 pid: 8414 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.051738:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000008a1161c/0x133f221c0877673f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b298a6 expref: 11 pid: 8414 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.051775:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008a1161c/0x133f221c0877673f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b298a6 expref: 11 pid: 8414 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.051789:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048621.051793:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048621.051801:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08776746 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b298ad expref: 10 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.051811:0:6481:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08776746 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b298ad expref: 10 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.051843:0:6481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08776746 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b298ad expref: 10 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048621.051856:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6481:1875953111410048:192.168.202.16@tcp:105: 00000100:00100000:1.0:1789048621.051917:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c42300 going to sleep for 11 seconds 00000100:00100000:1.0:1789048621.054247:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6481:1875953111410048:192.168.202.16@tcp:105: 00010000:00010000:1.0:1789048621.054277:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048621.054421:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c07ceb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+10:2393:x1875953097704448:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2639us (3002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048621.054432:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 73 00000100:00100000:2.0:1789048621.059986:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048621.060132:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097704576 00000100:00100000:3.0:1789048621.060142:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097704576 00002000:00100000:3.0:1789048621.060189:0:8418:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff959b08844a80 x1875953097704576/t0(0) o4->85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp:632/0 lens 504/0 e 0 to 0 dl 1789048632 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789048621.060214:0:8418:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b08844a80 with x1875953097704576 ext(0->12) 00002000:00010000:3.0:1789048621.060219:0:8418:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff959b08844a80 00000100:00100000:3.0:1789048621.060323:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:3.0:1789048621.060376:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+10:2394:x1875953097704576:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789048621.061812:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+12:2394:x1875953097704576:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 Request processed in 1472us (1828us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789048621.061824:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00002000:00100000:3.0:1789048621.061835:0:8418:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff959b08844a80 x1875953097704576/t4294967309(0) o4->85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp:632/0 lens 504/448 e 0 to 0 dl 1789048632 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789048621.061846:0:8418:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b08844a80 with x1875953097704576 ext(0->12) 00002000:00010000:3.0:1789048621.061852:0:8418:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff959b08844a80 00000100:00100000:2.0:1789048621.065813:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048621.065929:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097704704 00000100:00100000:1.0:1789048621.065940:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097704704 00000100:00100000:1.0:1789048621.066051:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 136 00000100:00100000:1.0:1789048621.066074:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+70:11400:x1875953097704704:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789048621.069023:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967406 is committed 00000004:00080000:0.0:1789048621.069050:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:3.0:1789048621.069146:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c0877644b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069159:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c0877644b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069167:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c0877644b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069174:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048621.069178:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c0877644b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069187:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c0877644b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069214:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff959c02b11700) 00010000:00010000:3.0:1789048621.069217:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048621.069223:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c0877644b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069230:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c0877644b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069258:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069265:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069271:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069276:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048621.069289:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069295:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069304:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff959c18359600) 00010000:00010000:3.0:1789048621.069306:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048621.069309:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764f3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069316:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087764f3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069385:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776571 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069392:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776571 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069397:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776571 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069402:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048621.069405:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776571 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069411:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776571 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069431:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c02b11600) 00010000:00010000:3.0:1789048621.069433:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048621.069435:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776571 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069440:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776571 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069451:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776594 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069456:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776594 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069461:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776594 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069472:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048621.069475:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776594 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069481:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776594 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069490:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c02b11600) 00010000:00010000:3.0:1789048621.069492:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048621.069495:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776594 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069502:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776594 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069515:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776666 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069521:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776666 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069536:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776666 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069541:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048621.069543:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776666 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069549:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776666 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069566:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:3.0:1789048621.069568:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048621.069571:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776666 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069576:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776666 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069588:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776723 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069594:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776723 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069599:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776723 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069605:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048621.069607:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776723 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069613:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776723 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069621:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff959c18359b00) 00010000:00010000:3.0:1789048621.069623:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789048621.069626:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776723 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.069631:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776723 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048621.070353:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111410304:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789048621.070443:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048621.070498:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111410304 00000100:00100000:2.0:1789048621.070505:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111410304 00000100:00100000:2.0:1789048621.070730:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789048621.070739:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fbaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3620:x1875953111410304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789048621.070858:0:8804:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789048621.070861:0:8804:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789048621668353723 00002000:00010000:2.0:1789048621.070864:0:8804:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789048621.070866:0:8804:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789048621631000000 -> 1789048621668353723 00002000:00010000:2.0:1789048621.070868:0:8804:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789048621.070907:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fbaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3620:x1875953111410304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 169us (464us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789048621.070914:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1789048621.070958:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789048621.070990:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff959c3fba8380/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789048621.070995:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111410304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789048621.071675:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fbaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111410176:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789048621.071729:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048621.071878:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111410176 00000100:00100000:2.0:1789048621.071885:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111410176 00000100:00100000:2.0:1789048621.071930:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789048621.071939:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3623:x1875953111410176:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789048621.071968:0:8413:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:2.0:1789048621.071990:0:8413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe7a04a4/0x133f221c0877674d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.072188:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4d002ad/0x133f221c08776501 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29805 expref: 11 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.072198:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789048621.072202:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789048621.072207:0:8413:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe7a04a4/0x133f221c0877674d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.072238:0:8413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e4d002ad/0x133f221c08776501 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.16@tcp remote: 0xd796648991b29805 expref: 11 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.072253:0:8413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e4d002ad/0x133f221c08776501 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.16@tcp remote: 0xd796648991b29805 expref: 11 pid: 8412 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048621.072265:0:8413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1875953111410432:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789048621.072501:0:8413:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b08113b40 going to sleep for 11 seconds 00000004:00080000:0.0:1789048621.075299:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1789048621.075320:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff959c05d31000 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1789048621.075326:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff959b0832b900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff959c05d31e40 00000020:00080000:0.0:1789048621.075329:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff959b0832b200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff959c3ed40200 00000020:00080000:0.0:1789048621.075400:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff959b07b08a80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1789048621.075404:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff959b08281500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff959b07b08d80 00000020:00080000:0.0:1789048621.075407:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff959b08281000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff959b08162600 00000020:00080000:0.0:1789048621.075446:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1789048621.075517:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789048621.076028:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:11400:x1875953097704704:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 Request processed in 9950us (10220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048621.076049:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 136 00000100:00100000:2.0:1789048621.076329:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789048621.076357:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111410560:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789048621.076410:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048621.076460:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111410560 00000100:00100000:2.0:1789048621.076467:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111410560 00000100:00100000:2.0:1789048621.076513:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789048621.076532:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fbab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111410560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789048621.076553:0:8804:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:2.0:1789048621.076577:0:8804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x18d3fa3dc23640a9, atime: 0x18d3fa3dcc69b4f7, ctime: 0x18d3fa3dc23640a9, blocks: 0x8 00010000:00010000:2.0:1789048621.076583:0:8804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f80eb09d/0x133f221c08776754 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.076596:0:8804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=375s v=(0 0) 00010000:00010000:2.0:1789048621.076599:0:8804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048621.076604:0:8804:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f80eb09d/0x133f221c08776754 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.076615:0:8804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f80eb09d/0x133f221c08776754 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.076622:0:8804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f80eb09d/0x133f221c08776754 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.076627:0:8804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f80eb09d/0x133f221c08776754 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.076639:0:8804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789048621.076759:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fbab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3620:x1875953111410560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 239us (348us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789048621.076773:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1789048621.076794:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048621.076799:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f80eb09d/0x133f221c08776754 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.076807:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0000 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048621.076811:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f80eb09d/0x133f221c08776754 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.076820:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f80eb09d/0x133f221c08776754 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.076836:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f80eb09d/0x133f221c08776754 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.076843:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f80eb09d/0x133f221c08776754 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.076861:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048621.076863:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048621.076865:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789048621.076872:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789048621.076899:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1789048621.076905:0:3620:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967304 00000004:00080000:2.0:1789048621.076921:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff959c04caa680, transno 4294967302 00000004:00080000:2.0:1789048621.076929:0:3620:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967304 00000100:00100000:2.0:1789048621.076943:0:3620:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff959c3fba9180 x1875953111410560/t4294967305(4294967305) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789048637 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789048621.076972:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff959c3fba9180/2, rc 0, transno 4294967305 00000100:00100000:2.0:1789048621.076976:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111410560:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789048621.081756:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048621.081982:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097704832 00000100:00100000:3.0:1789048621.081991:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097704832 00010000:00010000:3.0:1789048621.082039:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e4d002ad/0x133f221c08776501 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.16@tcp remote: 0xd796648991b29805 expref: 12 pid: 8412 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048621.082081:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 74 00000100:00100000:3.0:1789048621.082090:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+12:2394:x1875953097704832:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048621.082104:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048621.082110:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e4d002ad/0x133f221c08776501 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.16@tcp remote: 0xd796648991b29805 expref: 12 pid: 8412 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.082123:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e4d002ad/0x133f221c08776501 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.16@tcp remote: 0xd796648991b29805 expref: 12 pid: 8412 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.082145:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789048621.082150:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789048621.082155:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe7a04a4/0x133f221c0877674d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.082165:0:6483:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe7a04a4/0x133f221c0877674d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.082184:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048621.082229:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+12:2394:x1875953097704832:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 139us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048621.082252:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 74 00010000:00010000:1.0:1789048621.083565:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4d002ad/0x133f221c08776501 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.16@tcp remote: 0xd796648991b29805 expref: 11 pid: 8412 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048621.083587:0:8413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1875953111410432:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789048621.083609:0:8413:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fe7a04a4/0x133f221c0877674d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.083619:0:8413:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fe7a04a4/0x133f221c0877674d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.083626:0:8413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe7a04a4/0x133f221c0877674d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.083635:0:8413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe7a04a4/0x133f221c0877674d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.083642:0:8413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe7a04a4/0x133f221c0877674d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.083803:0:8413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789048621.083998:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3623:x1875953111410176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12059us (12267us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789048621.084015:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:3.0:1789048621.084100:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff959c3fbaa300/2, rc 0, transno 4294967311 00000100:00100000:3.0:1789048621.084107:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fbaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111410176:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789048621.084981:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:2.0:1789048621.085110:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048621.085119:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe7a04a4/0x133f221c0877674d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048621.085123:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097704960 00010000:00010000:2.0:1789048621.085129:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1a00 already unused, calling callback (ffffffffc0c858f0) 00000100:00100000:1.0:1789048621.085130:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097704960 00010000:00010000:2.0:1789048621.085133:0:7447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe7a04a4/0x133f221c0877674d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.085142:0:7447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe7a04a4/0x133f221c0877674d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.085162:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe7a04a4/0x133f221c0877674d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.085170:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe7a04a4/0x133f221c0877674d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.085193:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048621.085196:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048621.085197:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048621.085212:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:1.0:1789048621.085222:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+11:2393:x1875953097704960:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789048621.087116:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1789048621.087132:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1789048621.087675:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097704960:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 Request processed in 2448us (2693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048621.087761:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:0.0:1789048621.092639:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048621.092879:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097705216 00000100:00100000:1.0:1789048621.092888:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097705216 00000100:00100000:1.0:1789048621.092992:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 137 00000100:00100000:1.0:1789048621.093016:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:11400:x1875953097705216:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789048621.093082:0:8649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048621.093109:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776738 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2989f expref: 16 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.093129:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff959c18359b00) 00010000:00010000:1.0:1789048621.093134:0:8649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789048621.093164:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877675b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.093178:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877675b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.093201:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877675b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789048621.093393:0:8649:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000002bc5e6fa reply state 00000000d005975a transno 4294967407 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877675b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.093406:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877675b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.093412:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff959c18359b00) 00010000:00010000:1.0:1789048621.093415:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789048621.093417:0:8649:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789048621.093520:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+17:11400:x1875953097705216:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 507us (891us total) trans 4294967407 rc 0/0 00000100:00100000:1.0:1789048621.093541:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 137 00000100:00100000:3.0:1789048621.097552:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048621.097667:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097705344 00000100:00100000:2.0:1789048621.097677:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097705344 00000100:00100000:2.0:1789048621.097744:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:2.0:1789048621.097755:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2ecbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097705344:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789048621.097946:0:8414:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789048621.097958:0:8414:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789048621668353723 -> 1789048620658000000 00002000:00010000:2.0:1789048621.097961:0:8414:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789048620325000000 00002000:00010000:2.0:1789048621.097963:0:8414:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789048621668353723 -> 1789048620658000000 00002000:00010000:2.0:1789048621.097965:0:8414:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789048621.098033:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2ecbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2394:x1875953097705344:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 278us (491us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789048621.098041:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:2.0:1789048621.102081:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048621.102175:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097705600 00000100:00100000:3.0:1789048621.102185:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097705600 00000100:00100000:3.0:1789048621.102238:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 138 00000100:00100000:3.0:1789048621.102246:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fbaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+17:11400:x1875953097705600:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789048621.102304:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776762 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.102317:0:12131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c0877671c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29891 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.102324:0:12131:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776762 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.102379:0:12131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c0877671c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29891 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.102389:0:12131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c0877671c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29891 expref: 17 pid: 6498 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048621.102399:0:12131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08886680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12131:1875953111410688:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048621.102467:0:12131:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2b027cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048621.105632:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048621.105830:0:12131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08886680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12131:1875953111410688:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048621.105865:0:12131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776762 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048621.106006:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097705728 00000100:00100000:0.0:1789048621.106012:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097705728 00010000:00010000:0.0:1789048621.106050:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c0877671c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29891 expref: 18 pid: 6498 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048621.106100:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 75 00000100:00100000:0.0:1789048621.106107:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fbab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+18:2393:x1875953097705728:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048621.106120:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048621.106125:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c0877671c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29891 expref: 18 pid: 6498 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.106142:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c0877671c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29891 expref: 18 pid: 6498 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.106158:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c0877671c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29891 expref: 18 pid: 6498 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.106170:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff959c18359b00) 00010000:00010000:0.0:1789048621.106173:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776762 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.106180:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776762 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.106185:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776762 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.106209:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048621.106251:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fbab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+17:2393:x1875953097705728:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 144us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048621.106256:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 75 00010000:00010000:3.0:1789048621.106308:0:12131:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776762 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.106316:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776762 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.106371:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776762 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.106377:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776762 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.106384:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776762 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.106389:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048621.106393:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776762 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.106400:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776762 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.106409:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff959c18359b00) 00010000:00010000:3.0:1789048621.106411:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789048621.106414:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776762 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.106419:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08776762 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048621.106468:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fbaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:11400:x1875953097705600:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 Request processed in 4222us (4395us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789048621.106476:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 138 00000100:00100000:2.0:1789048621.109859:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048621.109943:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097705856 00000100:00100000:3.0:1789048621.109963:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097705856 00000100:00100000:3.0:1789048621.110045:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:3.0:1789048621.110057:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2394:x1875953097705856:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789048621.110100:0:8804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c08776769 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.110119:0:8804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08776746 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b298ad expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.110128:0:8804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048621.110132:0:8804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789048621.110136:0:8804:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c08776769 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.110168:0:8804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08776746 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0xd796648991b298ad expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.110181:0:8804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08776746 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b298ad expref: 7 pid: 8412 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048621.110196:0:8804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08886680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8804:1875953111410816:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048621.110298:0:8804:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2b027cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048621.113907:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048621.113944:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097705984 00000100:00100000:2.0:1789048621.113962:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097705984 00010000:00010000:2.0:1789048621.114006:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08776746 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b298ad expref: 8 pid: 8412 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048621.114042:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 76 00000100:00100000:2.0:1789048621.114052:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2393:x1875953097705984:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048621.114066:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048621.114089:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08776746 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b298ad expref: 8 pid: 8412 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.114103:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08776746 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b298ad expref: 8 pid: 8412 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.114149:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789048621.114153:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789048621.114159:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c08776769 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.114169:0:6483:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c08776769 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.114191:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048621.114240:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2393:x1875953097705984:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 188us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048621.114247:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 76 00010000:00010000:3.0:1789048621.115493:0:8804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08776746 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b298ad expref: 7 pid: 8412 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048621.115514:0:8804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08886680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8804:1875953111410816:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048621.115611:0:8804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c08776769 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.115622:0:8804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c08776769 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.115630:0:8804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c08776769 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.115657:0:8804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c08776769 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.115665:0:8804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c08776769 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.115675:0:8804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c08776769 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.115776:0:8804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3da00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048621.115780:0:8804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c08776769 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.115807:0:8804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c08776769 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.115824:0:8804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c08776769 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.115832:0:8804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c08776769 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048621.115903:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097705856:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 Request processed in 5849us (6053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048621.115912:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:2.0:1789048621.118836:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048621.118906:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097706240 00000100:00100000:1.0:1789048621.118917:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097706240 00000100:00100000:1.0:1789048621.119013:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 139 00000100:00100000:1.0:1789048621.119023:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:11400:x1875953097706240:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789048621.119107:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c08776770 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.119124:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877665f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29859 expref: 16 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.119133:0:6497:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c08776770 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.119166:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877665f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29859 expref: 16 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.119192:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877665f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29859 expref: 16 pid: 8649 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048621.119207:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875953111410944:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789048621.119276:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c420c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048621.122917:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048621.122999:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097706368 00000100:00100000:3.0:1789048621.123008:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097706368 00010000:00010000:3.0:1789048621.123061:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877665f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29859 expref: 17 pid: 8649 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048621.123105:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 77 00000100:00100000:3.0:1789048621.123115:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+17:2393:x1875953097706368:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048621.123129:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048621.123137:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877665f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29859 expref: 17 pid: 8649 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.123149:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877665f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29859 expref: 17 pid: 8649 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.123192:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:3.0:1789048621.123198:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087766c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2987c expref: 17 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.123208:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c08776770 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.123216:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c08776770 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.123224:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c08776770 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.123243:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048621.123303:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+17:2393:x1875953097706368:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 189us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048621.123311:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 77 00010000:00010000:2.0:1789048621.124893:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877665f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29859 expref: 16 pid: 8649 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048621.124917:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875953111410944:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789048621.124940:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c08776770 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.124958:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c08776770 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.124964:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c08776770 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.125192:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776777 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.125211:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877672a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29898 expref: 16 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.125220:0:6497:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776777 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.125252:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877672a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29898 expref: 16 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.125267:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877672a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29898 expref: 16 pid: 6499 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048621.125280:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875953111411072:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789048621.125394:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b08113240 going to sleep for 11 seconds 00000100:00100000:2.0:1789048621.129213:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875953111411072:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789048621.129242:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776777 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048621.130021:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048621.130099:0:13167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097706496 00000100:00100000:2.0:1789048621.130107:0:13167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097706496 00010000:00010000:2.0:1789048621.130145:0:13167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877672a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29898 expref: 17 pid: 6499 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048621.130176:0:13167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00100000:2.0:1789048621.130185:0:13167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+17:2394:x1875953097706496:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048621.130200:0:13167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048621.130220:0:13167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877672a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29898 expref: 17 pid: 6499 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.130232:0:13167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877672a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29898 expref: 17 pid: 6499 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.130255:0:13167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877672a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29898 expref: 17 pid: 6499 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.130270:0:13167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff959c18359b00) 00010000:00010000:2.0:1789048621.130275:0:13167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776777 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.130297:0:13167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776777 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.130304:0:13167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776777 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.130361:0:13167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048621.130408:0:13167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:2394:x1875953097706496:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 223us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048621.130416:0:13167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 78 00010000:00010000:1.0:1789048621.130710:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776777 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.130718:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776777 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789048621.130834:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000001:00080000:1.0:1789048621.130963:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00000001:00080000:1.0:1789048621.131002:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00000100:00100000:1.0:1789048621.131093:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6497:1875953111411200:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789048621.131138:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048621.131173:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2aed7840 going to sleep for 11 seconds 00000100:00100000:3.0:1789048621.131299:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111411200 00000100:00100000:3.0:1789048621.131305:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111411200 00000100:00100000:3.0:1789048621.131373:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789048621.131381:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6497:x1875953111411200:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789048621.131457:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6497:x1875953111411200:12345-0@lo:1000:mdt00_000.0 Request processed in 77us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048621.131464:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789048621.131670:0:6497:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1789048621.131676:0:6497:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:1.0:1789048621.131763:0:6497:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff959c3fba8380, transno 4294967310 00000004:00080000:1.0:1789048621.131827:0:6497:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff959c3fbaa300, transno 4294967311 00000100:00100000:1.0:1789048621.132922:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6497:1875953111411200:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789048621.134638:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967411 00000100:00100000:1.0:1789048621.134777:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c064b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6497:1875953111411328:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789048621.134853:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048621.134935:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06976b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789048621.134984:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111411328 00000100:00100000:0.0:1789048621.134991:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111411328 00000100:00100000:0.0:1789048621.135140:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789048621.135152:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6497:x1875953111411328:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789048621.135448:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6497:x1875953111411328:12345-0@lo:1000:mdt00_000.0 Request processed in 298us (592us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789048621.135456:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789048621.135660:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c064b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6497:1875953111411328:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789048621.135712:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776777 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.135724:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776777 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.135732:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776777 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.135739:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048621.135744:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776777 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.135753:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776777 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.135769:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff959c18359b00) 00010000:00010000:1.0:1789048621.135772:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789048621.135777:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776777 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.135784:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776777 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.135806:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087766ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.135813:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087766ba lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.135825:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087766ba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.135830:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048621.135833:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087766ba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.135839:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087766ba lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.135848:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:1.0:1789048621.135850:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789048621.135857:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087766c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2987c expref: 19 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.135869:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087766c1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2987c expref: 19 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.135878:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087766c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2987c expref: 19 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048621.135906:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087766c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2987c expref: 19 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048621.135919:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875953111411456:192.168.202.16@tcp:105: 00000100:00100000:1.0:1789048621.136003:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c42f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789048621.142870:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048621.142985:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097706624 00000100:00100000:0.0:1789048621.142995:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097706624 00000100:00100000:0.0:1789048621.143054:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:0.0:1789048621.143065:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:11399:x1875953097706624:12345-192.168.202.16@tcp:49:lfs.0 00000100:00100000:0.0:1789048621.143193:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:11399:x1875953097706624:12345-192.168.202.16@tcp:49:lfs.0 Request processed in 129us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048621.143201:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:3.0:1789048621.146566:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048621.146610:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097706880 00000100:00100000:3.0:1789048621.146620:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097706880 00000100:00100000:3.0:1789048621.146762:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 140 00000100:00100000:3.0:1789048621.146772:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:11399:x1875953097706880:12345-192.168.202.16@tcp:58:lfs.0 00000040:00080000:3.0:1789048621.146945:0:8649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789048621.147049:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:11399:x1875953097706880:12345-192.168.202.16@tcp:58:lfs.0 Request processed in 277us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048621.147057:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 140 00000100:00100000:2.0:1789048621.147588:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875953111411456:192.168.202.16@tcp:105: 00010000:00010000:2.0:1789048621.147616:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087766ba lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.147628:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087766ba lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.147671:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c0877677e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.147695:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c0877677e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.147707:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c0877677e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.147717:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c0877677e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.147724:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c0877677e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.147730:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c0877677e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.147736:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048621.147740:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c0877677e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.147746:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c0877677e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.147756:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:2.0:1789048621.147759:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048621.147762:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c0877677e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.147767:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c0877677e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.147785:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c08776770 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.147790:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c08776770 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.147796:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c08776770 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.147801:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048621.147804:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c08776770 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.147810:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c08776770 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.147818:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:2.0:1789048621.147820:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789048621.147823:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c08776770 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.147828:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c08776770 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048621.147929:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+19:11400:x1875953097706240:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 28907us (29100us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789048621.147938:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 139 00000020:00080000:2.0:1789048621.147942:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789048621.149325:0:13779:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789048621.149348:0:13779:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789048621.149386:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789048621.149393:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789048621.149510:0:13779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08886300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13779:1875953111411584:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789048621.149836:0:13779:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2b027f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789048621.167429:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048621.167622:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097707136 00000100:00100000:0.0:1789048621.167632:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097707136 00000100:00100000:0.0:1789048621.167694:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:0.0:1789048621.167704:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b2ab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:11400:x1875953097707136:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789048621.167983:0:6500:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789048621.168026:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967413 00010000:00010000:0.0:1789048621.168076:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c08776785 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.168100:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c08776785 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.168113:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c08776785 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.168121:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c08776785 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.168127:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c08776785 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.168134:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c08776785 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048621.168178:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789048621.168272:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b2ab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+22:11400:x1875953097707136:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 568us (852us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789048621.168281:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 32 00000020:00080000:0.0:1789048621.168286:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789048621.168318:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048621.168355:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c08776785 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.168363:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048621.168366:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c08776785 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.168373:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c08776785 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.168385:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff959c18359b00) 00010000:00010000:2.0:1789048621.168387:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789048621.168391:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c08776785 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.168395:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39600/0x133f221c08776785 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.168404:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048621.168405:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048621.168406:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048621.172373:0:13779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08886300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13779:1875953111411584:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789048621.175469:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048621.175566:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097707264 00000100:00100000:3.0:1789048621.175575:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097707264 00000100:00100000:3.0:1789048621.175641:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00100000:3.0:1789048621.175651:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+21:11403:x1875953097707264:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789048621.175695:0:12131:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789048621.175823:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+21:11403:x1875953097707264:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 173us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048621.175831:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00100000:2.0:1789048621.179848:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048621.179895:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097707520 00000100:00100000:3.0:1789048621.179905:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097707520 00000100:00100000:3.0:1789048621.179980:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 142 00000100:00100000:3.0:1789048621.179991:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+21:11403:x1875953097707520:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789048621.180032:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048621.180132:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c0877678c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b298b4 expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.180236:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c08776793 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.180252:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c08776793 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.180265:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c08776793 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048621.180278:0:8649:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789048621.180511:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c0877678c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298b4 expref: 24 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.180532:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c08776793 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298b4 expref: 23 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.180541:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:3.0:1789048621.180543:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789048621.180547:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3da00, rc 0) 00000100:00100000:3.0:1789048621.180608:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+23:11403:x1875953097707520:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 619us (767us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789048621.180615:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 142 00000100:00100000:0.0:1789048621.185270:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048621.185480:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097707648 00000100:00100000:2.0:1789048621.185490:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097707648 00000100:00100000:2.0:1789048621.185615:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 143 00000100:00100000:2.0:1789048621.185625:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+23:11402:x1875953097707648:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048621.185647:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048621.185670:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c087767a1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b298bb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.185762:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c087767a8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.185779:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c087767a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.185791:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c087767a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.185804:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087767af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.185811:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087767af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.185817:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087767af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.185890:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087767b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.185901:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087766ac lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29875 expref: 24 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.185909:0:6497:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087767b6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.185936:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087766ac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29875 expref: 24 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.185972:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087766ac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29875 expref: 24 pid: 12131 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048621.185986:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fbabb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875953111411712:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789048621.186592:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b08113240 going to sleep for 11 seconds 00000100:00100000:3.0:1789048621.187079:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048621.187447:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097707904 00000100:00100000:2.0:1789048621.187454:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097707904 00000100:00100000:2.0:1789048621.187494:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 144 00000100:00100000:2.0:1789048621.187501:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+25:11403:x1875953097707904:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789048621.187561:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c087767bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.187571:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c087767bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.187578:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c087767bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.187700:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c087767bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.187708:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c087767bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.187714:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c087767bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.187720:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048621.187733:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c087767bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.187742:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c087767bd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.187751:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:2.0:1789048621.187753:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789048621.187756:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c087767bd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048621.187761:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c087767bd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048621.187838:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+26:11403:x1875953097707904:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 337us (761us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1789048621.187843:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 144 00000040:00080000:1.0:1789048621.188562:0:13779:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789048621.188573:0:13779:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1789048621.190124:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fbabb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875953111411712:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789048621.190153:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087767b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048621.192091:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048621.192132:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048621.192363:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097708416 00000100:00100000:0.0:1789048621.192372:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097708416 00000100:00100000:0.0:1789048621.192405:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097708160 00000100:00100000:0.0:1789048621.192407:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097708160 00000100:00100000:0.0:1789048621.192416:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:0.0:1789048621.192422:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+27:11403:x1875953097708416:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789048621.192610:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+28:11403:x1875953097708416:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 186us (562us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789048621.192618:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:0.0:1789048621.192636:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:0.0:1789048621.192643:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+27:6166:x1875953097708160:12345-192.168.202.16@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789048621.192712:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+28:6166:x1875953097708160:12345-192.168.202.16@tcp:35:ldlm_bl.0 Request processed in 69us (579us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1789048621.192719:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:0.0:1789048621.194467:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048621.194529:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097708544 00000100:00100000:3.0:1789048621.194535:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097708544 00010000:00010000:3.0:1789048621.194566:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087766ac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29875 expref: 28 pid: 12131 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048621.194594:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 79 00000100:00100000:3.0:1789048621.194600:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08842a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+28:2393:x1875953097708544:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048621.194609:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048621.194615:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087766ac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29875 expref: 28 pid: 12131 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.194624:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087766ac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29875 expref: 28 pid: 12131 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.194643:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0400/0x133f221c087766ac lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29875 expref: 28 pid: 12131 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.194655:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:3.0:1789048621.194660:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087767b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.194667:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087767b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.194673:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087767b6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.194696:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048621.194738:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08842a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+27:2393:x1875953097708544:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 136us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048621.194755:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 79 00010000:00010000:3.0:1789048621.195418:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087767b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.195426:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087767b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048621.195470:0:6497:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789048621.195473:0:6497:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789048621.195489:0:6497:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087767b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.195499:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087767b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.195505:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c087767a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.195510:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c087767a8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.195514:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c087767a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.195518:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048621.195984:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c087767a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.195992:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c087767a8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.196012:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:3.0:1789048621.196025:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048621.196030:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c087767a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.196043:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c087767a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.196057:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087767af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.196064:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087767af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.196070:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087767af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.196075:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048621.196078:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087767af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.196083:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087767af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.196090:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff959c02b11100) 00010000:00010000:3.0:1789048621.196092:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048621.196095:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087767af lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.196100:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087767af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.196139:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c087767a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298bb expref: 27 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.196164:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087767b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298bb expref: 26 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048621.196171:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:3.0:1789048621.196174:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789048621.196176:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb0c00, rc 0) 00000100:00100000:3.0:1789048621.196220:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+26:11402:x1875953097707648:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 10596us (10959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048621.196227:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 143 00000040:00080000:1.0:1789048621.200460:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789048621.200483:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789048622.046220:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789048622.089180:0:14241:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789048622.089191:0:14241:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789048622.089227:0:14241:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789048622.089234:0:14241:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789048622.144963:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048622.145009:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048622.145037:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048622.145066:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048622.145092:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048622.145121:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097709056 00000100:00100000:0.0:1789048622.145130:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097709056 00000100:00100000:0.0:1789048622.145176:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097709184 00000100:00100000:0.0:1789048622.145179:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097709184 00000100:00100000:0.0:1789048622.145210:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 111 00000100:00100000:0.0:1789048622.145219:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097709056:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048622.145293:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097709056:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 74us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048622.145300:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 111 00000100:00100000:0.0:1789048622.145319:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 112 00000100:00100000:0.0:1789048622.145327:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097709184:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048622.145384:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097709184:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 58us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048622.145390:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 112 00000100:00100000:0.0:1789048622.145410:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097708800 00000100:00100000:0.0:1789048622.145413:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097708800 00000100:00100000:0.0:1789048622.145439:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097709312 00000100:00100000:0.0:1789048622.145442:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097709312 00000100:00100000:0.0:1789048622.145459:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097708928 00000100:00100000:0.0:1789048622.145461:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097708928 00000100:00100000:0.0:1789048622.145475:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 311 00000100:00100000:0.0:1789048622.145482:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+26:2393:x1875953097708800:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048622.145515:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+26:2393:x1875953097708800:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 33us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048622.145521:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 311 00000100:00100000:0.0:1789048622.145545:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 312 00000100:00100000:0.0:1789048622.145553:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097709312:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048622.145576:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097709312:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 24us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048622.145582:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 312 00000100:00100000:0.0:1789048622.145593:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 313 00000100:00100000:0.0:1789048622.145599:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097708928:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048622.145619:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097708928:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 21us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048622.145624:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 313 00000100:00080000:0.0:1789048622.145647:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789048622.145651:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789048622.145653:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789048622.146463:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048622.146519:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097709440 00000100:00100000:3.0:1789048622.146524:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097709440 00000100:00100000:3.0:1789048622.146571:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 314 00000100:00100000:3.0:1789048622.146579:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097709440:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048622.146616:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097709440:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 38us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048622.146622:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 314 00000100:00080000:0.0:1789048622.146669:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048622.165383:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048622.165463:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097708672 00000100:00100000:1.0:1789048622.165473:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097708672 00000100:00100000:1.0:1789048622.165530:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 394 00000100:00100000:1.0:1789048622.165542:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2394:x1875953097708672:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048622.165610:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2394:x1875953097708672:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 70us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048622.165617:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 394 00000100:00100000:0.0:1789048622.351636:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048622.351715:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097709696 00000100:00100000:3.0:1789048622.351725:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097709696 00000100:00100000:3.0:1789048622.351860:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 145 00000100:00100000:3.0:1789048622.351872:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+26:11426:x1875953097709696:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789048622.351909:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048622.351932:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087767c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b298c2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048622.352055:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c087767cb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048622.352182:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c087767cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048622.352286:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c087767cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048622.352301:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789048622.352480:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087767c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298c2 expref: 29 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048622.352501:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c087767cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298c2 expref: 28 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048622.352510:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:3.0:1789048622.352513:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789048622.352517:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3d600, rc 0) 00000100:00100000:3.0:1789048622.352583:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+28:11426:x1875953097709696:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 714us (957us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1789048622.352592:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 145 00000100:00100000:1.0:1789048622.357934:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048622.358211:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097709824 00000100:00100000:3.0:1789048622.358221:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097709824 00000100:00100000:3.0:1789048622.358287:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 146 00000100:00100000:3.0:1789048622.358311:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+28:11426:x1875953097709824:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:3.0:1789048622.358725:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087767d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048622.358744:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087767d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048622.358757:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087767d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048622.358793:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087767d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048622.358801:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087767d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048622.358809:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087767d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048622.358815:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048622.358820:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087767d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048622.358827:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087767d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048622.358839:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:3.0:1789048622.358842:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789048622.358848:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087767d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048622.358855:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087767d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048622.359195:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+28:11426:x1875953097709824:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 885us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048622.359203:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 146 00000100:00100000:0.0:1789048622.508288:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048622.508468:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097709952 00000100:00100000:2.0:1789048622.508479:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097709952 00000100:00100000:2.0:1789048622.508539:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:2.0:1789048622.508551:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097709952:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:2.0:1789048622.508568:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048622.508589:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe7a04a4/0x133f221c087767e0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b298c9 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789048622.508636:0:8414:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x18d3fa3de0390080, atime: 0x18d3fa3dcc5fd340, ctime: 0x18d3fa3de0390080, blocks: 0x8 00010000:00010000:2.0:1789048622.508660:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1789048622.508664:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048622.508673:0:8414:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe7a04a4/0x133f221c087767e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298c9 expref: 7 pid: 8414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048622.508694:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe7a04a4/0x133f221c087767e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298c9 expref: 7 pid: 8414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048622.508709:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb1a00, rc 0) 00000100:00100000:2.0:1789048622.508786:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2393:x1875953097709952:12345-192.168.202.16@tcp:101:cat.0 Request processed in 237us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048622.508793:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:0.0:1789048622.520590:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048622.520703:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097710080 00000100:00100000:3.0:1789048622.520714:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097710080 00002000:00100000:3.0:1789048622.520892:0:8419:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff959b08841500 x1875953097710080/t0(0) o3->85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp:633/0 lens 488/0 e 0 to 0 dl 1789048633 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789048622.520905:0:8419:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b08841500 with x1875953097710080 ext(0->4095) 00002000:00010000:3.0:1789048622.520910:0:8419:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff959b08841500 00000100:00100000:3.0:1789048622.520999:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:3.0:1789048622.521010:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2393:x1875953097710080:12345-192.168.202.16@tcp:3:cat.0 00000100:00100000:3.0:1789048622.521199:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2393:x1875953097710080:12345-192.168.202.16@tcp:3:cat.0 Request processed in 190us (618us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789048622.521206:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00002000:00100000:3.0:1789048622.521215:0:8419:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff959b08841500 x1875953097710080/t0(0) o3->85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp:633/0 lens 488/4536 e 0 to 0 dl 1789048633 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789048622.521222:0:8419:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b08841500 with x1875953097710080 ext(0->4095) 00002000:00010000:3.0:1789048622.521225:0:8419:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff959b08841500 00010000:00010000:2.0:1789048623.070372:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048623.582975:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fbabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111411840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048623.583052:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048623.587183:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789048623.587204:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111411968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789048623.587273:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048623.587320:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111411840 00000100:00100000:0.0:1789048623.587327:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111411840 00000100:00100000:0.0:1789048623.587401:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111411968 00000100:00100000:0.0:1789048623.587404:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111411968 00000100:00100000:0.0:1789048623.587430:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789048623.587439:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111411840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789048623.587482:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048623.587527:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111411840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (4476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048623.587534:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789048623.587552:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789048623.587559:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875953111411968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789048623.587568:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048623.587591:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875953111411968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048623.587597:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1789048623.587612:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789048623.587645:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111411968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789048623.587661:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fbabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111411840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048623.590595:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111412224:0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.590673:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048623.590716:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111412736:0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.590743:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048623.590763:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875953111413248:0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.590780:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048623.590799:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789048623.590803:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111412096:0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.590830:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048623.590846:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111412608:0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.590865:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048623.590879:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111413120:0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.590896:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048623.590921:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111412480:0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.590956:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048623.590981:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111412992:0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.591000:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048623.591015:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789048623.591170:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111412352:0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.591193:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048623.591217:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111412864:0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.591234:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048623.591247:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111413376:0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.591262:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048623.591281:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111412224 00000100:00100000:3.0:1789048623.591288:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111412224 00000100:00100000:3.0:1789048623.591320:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111412736 00000100:00100000:3.0:1789048623.591322:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111412736 00000100:00100000:3.0:1789048623.591369:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111413248 00000100:00100000:3.0:1789048623.591372:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111413248 00000100:00100000:3.0:1789048623.591383:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111412480 00000100:00100000:3.0:1789048623.591385:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111412480 00000100:00100000:3.0:1789048623.591393:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111412864 00000100:00100000:3.0:1789048623.591396:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111412864 00000100:00100000:3.0:1789048623.591405:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111413376 00000100:00100000:3.0:1789048623.591407:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111413376 00000100:00100000:3.0:1789048623.591419:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789048623.591426:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111412224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.591470:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111412224:12345-0@lo:400:kworker.0 Request processed in 44us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048623.591477:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789048623.591491:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789048623.591496:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111412736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.591515:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111412736:12345-0@lo:400:kworker.0 Request processed in 20us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048623.591520:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789048623.591529:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1789048623.591533:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875953111413248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.591554:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875953111413248:12345-0@lo:400:kworker.0 Request processed in 21us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048623.591560:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1789048623.591568:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1789048623.591572:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111412480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.591593:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111412480:12345-0@lo:400:kworker.0 Request processed in 21us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048623.591607:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1789048623.591616:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789048623.591623:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111412864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.591644:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111412864:12345-0@lo:400:kworker.0 Request processed in 22us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048623.591649:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789048623.591657:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789048623.591662:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111413376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.591680:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111413376:12345-0@lo:400:kworker.0 Request processed in 19us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048623.591685:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789048623.591698:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111412608 00000100:00100000:3.0:1789048623.591701:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111412608 00000100:00100000:3.0:1789048623.591719:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111412352 00000100:00100000:3.0:1789048623.591721:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111412352 00000100:00100000:3.0:1789048623.591731:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789048623.591736:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111412608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.591761:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111412608:12345-0@lo:400:kworker.0 Request processed in 25us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048623.591766:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789048623.591774:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789048623.591779:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111412352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.591799:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111412352:12345-0@lo:400:kworker.0 Request processed in 20us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048623.591803:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789048623.591844:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111412608:0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.591853:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111412224:0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.591861:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111412736:0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.591868:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875953111413248:0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.591893:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111412352:0@lo:400:kworker.0 00010000:00080000:3.0:1789048623.591904:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08887b80 x1875953111412864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048623.591913:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111412864:0@lo:400:kworker.0 00010000:00080000:3.0:1789048623.591922:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08884a80 x1875953111413376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048623.591941:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111413376:0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.591950:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111412480:0@lo:400:kworker.0 00000100:00100000:0.0:1789048623.592269:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111412096 00000100:00100000:0.0:1789048623.592273:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111412096 00000100:00100000:0.0:1789048623.592353:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1789048623.592360:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3621:x1875953111412096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048623.592399:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3621:x1875953111412096:12345-0@lo:400:kworker.0 Request processed in 40us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048623.592405:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1789048623.592468:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111412096:0@lo:400:kworker.0 00000100:00100000:0.0:1789048623.592636:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111413120 00000100:00100000:0.0:1789048623.592640:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111413120 00000100:00100000:0.0:1789048623.592694:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111412992 00000100:00100000:0.0:1789048623.592697:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111412992 00000100:00100000:3.0:1789048623.594471:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789048623.594490:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111413120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.594576:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111413120:12345-0@lo:400:kworker.0 Request processed in 93us (3678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048623.594583:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789048623.594605:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789048623.594612:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111412992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048623.594658:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111412992:12345-0@lo:400:kworker.0 Request processed in 47us (3656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048623.594673:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789048623.595428:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111412992:0@lo:400:kworker.0 00000100:00100000:2.0:1789048623.595670:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111413120:0@lo:400:kworker.0 00000100:00080000:0.0:1789048623.599182:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789048623.599193:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789048623.599213:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789048624.098607:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111413504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048624.098676:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048624.099706:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111413504 00000100:00100000:0.0:1789048624.099717:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111413504 00000100:00100000:0.0:1789048624.099774:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789048624.099784:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111413504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789048624.099818:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00010000:00010000:3.0:1789048624.100035:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048624.105284:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111413504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5491us (6596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048624.105304:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789048624.109864:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111413504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789048624.605653:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789048624.605677:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111413632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048624.605748:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048624.605969:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111413632 00000100:00100000:2.0:1789048624.605977:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111413632 00000100:00100000:2.0:1789048624.606042:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789048624.606053:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111413632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789048624.606081:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789048624.606129:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111413632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048624.606137:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789048624.606183:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111413632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048624.610084:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111413760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789048624.610157:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048624.610358:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111413760 00000100:00100000:3.0:1789048624.610367:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111413760 00000100:00100000:3.0:1789048624.610459:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789048624.610469:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111413760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789048624.610490:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789048624.610557:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111413760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048624.610564:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789048624.610653:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111413760:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789048625.119230:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048625.630197:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111413888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048625.630322:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048625.630597:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111413888 00000100:00100000:3.0:1789048625.630605:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111413888 00000100:00100000:3.0:1789048625.630648:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789048625.630658:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111413888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789048625.630692:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789048625.630737:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111413888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048625.630744:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789048625.630846:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111413888:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789048626.152231:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789048626.336317:0:13779:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789048626.336327:0:13779:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789048626.336380:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789048626.336390:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789048626.845937:0:13781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789048627.165528:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789048627.173513:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1789048627.173529:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1789048627.175483:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967419 is committed 00000020:00080000:2.0:1789048627.175515:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff959c2aed7780 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1789048627.175519:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff959c03617900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff959c2aed7840 00000020:00080000:2.0:1789048627.175522:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff959c03617e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff959b06bca400 00010000:00010000:3.0:1789048627.176558:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877675b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048627.176573:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877675b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048627.176593:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877675b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048627.176600:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048627.176605:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877675b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048627.176613:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877675b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048627.176631:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff959c18359b00) 00010000:00010000:3.0:1789048627.176634:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048627.176639:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877675b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048627.176646:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877675b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789048627.177382:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1789048627.178106:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789048627.178184:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1789048627.179370:0:9492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:1.0:1789048627.262875:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048627.262923:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048627.262948:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048627.262970:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048627.262988:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048627.263004:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048627.263022:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048627.263056:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097710592 00000100:00100000:1.0:1789048627.263065:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097710592 00000100:00100000:1.0:1789048627.263123:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097710720 00000100:00100000:1.0:1789048627.263126:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097710720 00000100:00100000:1.0:1789048627.263152:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 115 00000100:00100000:1.0:1789048627.263162:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097710592:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048627.263225:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097710592:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 64us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048627.263233:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 115 00000100:00100000:1.0:1789048627.263251:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 116 00000100:00100000:1.0:1789048627.263257:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097710720:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048627.263279:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097710720:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 23us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048627.263285:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 116 00000100:00100000:1.0:1789048627.263304:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097710336 00000100:00100000:1.0:1789048627.263308:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097710336 00000100:00100000:1.0:1789048627.263365:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097710848 00000100:00100000:1.0:1789048627.263369:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097710848 00000100:00100000:1.0:1789048627.263384:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097710464 00000100:00100000:1.0:1789048627.263387:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097710464 00000100:00100000:1.0:1789048627.263398:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097710976 00000100:00100000:1.0:1789048627.263401:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097710976 00000100:00100000:1.0:1789048627.263415:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 321 00000100:00100000:1.0:1789048627.263421:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:2394:x1875953097710336:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048627.263448:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:2394:x1875953097710336:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 28us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048627.263455:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 321 00000100:00100000:1.0:1789048627.263474:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 322 00000100:00100000:1.0:1789048627.263495:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097710848:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048627.263521:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097710848:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 41us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048627.263527:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 322 00000100:00100000:1.0:1789048627.263539:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 323 00000100:00100000:1.0:1789048627.263545:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097710464:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048627.263569:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097710464:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 24us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048627.263575:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 323 00000100:00100000:1.0:1789048627.263587:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 324 00000100:00100000:1.0:1789048627.263593:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097710976:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048627.263614:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097710976:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 22us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048627.263620:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 324 00000100:00100000:1.0:1789048627.263638:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097710208 00000100:00100000:1.0:1789048627.263642:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097710208 00000100:00100000:1.0:1789048627.263669:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 396 00000100:00100000:1.0:1789048627.263675:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2394:x1875953097710208:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048627.263698:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2394:x1875953097710208:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 23us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048627.263705:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 396 00000100:00080000:1.0:1789048627.263741:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789048627.263745:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789048627.263754:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789048627.263757:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789048627.493760:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048627.493904:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097711104 00000100:00100000:3.0:1789048627.493915:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097711104 00000100:00100000:3.0:1789048627.493992:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 147 00000100:00100000:3.0:1789048627.494003:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0884b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:11087:x1875953097711104:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789048627.494110:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0884b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:11087:x1875953097711104:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 Request processed in 109us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048627.494117:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 147 00000100:00100000:1.0:1789048627.495846:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048627.495948:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097711232 00000100:00100000:0.0:1789048627.495957:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097711232 00000100:00100000:0.0:1789048627.496018:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 148 00000100:00100000:0.0:1789048627.496030:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:11087:x1875953097711232:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789048627.496136:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:11087:x1875953097711232:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 Request processed in 108us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048627.496145:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 148 00000100:00100000:0.0:1789048627.502159:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048627.502273:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097711488 00000100:00100000:3.0:1789048627.502284:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097711488 00000100:00100000:3.0:1789048627.502380:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:3.0:1789048627.502393:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:11087:x1875953097711488:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789048627.502657:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+15:11087:x1875953097711488:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 266us (511us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789048627.502664:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 35 00010000:00010000:0.0:1789048628.192804:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048628.701955:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789048628.701987:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111414016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048628.702213:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048628.702476:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08a07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111414144:0@lo:400:kworker.0 00000100:00100000:0.0:1789048628.702531:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048628.702571:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08a05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111414656:0@lo:400:kworker.0 00000100:00100000:0.0:1789048628.702602:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048628.702621:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111415168:0@lo:400:kworker.0 00000100:00100000:0.0:1789048628.702652:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048628.702700:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111414016 00000100:00100000:3.0:1789048628.702714:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111414016 00000100:00100000:3.0:1789048628.702784:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789048628.702798:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111414016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789048628.702833:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048628.702908:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111414016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048628.702915:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1789048628.702938:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789048628.702958:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08a04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111414400:0@lo:400:kworker.0 00000100:00100000:3.0:1789048628.702989:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048628.703007:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111414912:0@lo:400:kworker.0 00000100:00100000:3.0:1789048628.703025:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048628.703033:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08a05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111414528:0@lo:400:kworker.0 00000100:00100000:3.0:1789048628.703049:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08a07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111415424:0@lo:400:kworker.0 00000100:00100000:1.0:1789048628.703094:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048628.703098:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111414656 00000100:00100000:3.0:1789048628.703103:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111414656 00000100:00100000:3.0:1789048628.703137:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111414400 00000100:00100000:3.0:1789048628.703141:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111414400 00000100:00100000:1.0:1789048628.703148:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08a06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111415040:0@lo:400:kworker.0 00000100:00100000:0.0:1789048628.703149:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789048628.703162:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789048628.703171:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08a05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111414272:0@lo:400:kworker.0 00000100:00100000:3.0:1789048628.703172:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111414656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048628.703225:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048628.703241:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111414656:12345-0@lo:400:kworker.0 Request processed in 71us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048628.703247:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789048628.703259:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08a07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111414784:0@lo:400:kworker.0 00000100:00100000:3.0:1789048628.703262:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789048628.703270:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111414400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048628.703297:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048628.703300:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111414400:12345-0@lo:400:kworker.0 Request processed in 30us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048628.703306:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789048628.703322:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111414912 00000100:00100000:3.0:1789048628.703324:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111414912 00000100:00100000:0.0:1789048628.703326:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08a04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111415296:0@lo:400:kworker.0 00000100:00100000:3.0:1789048628.703369:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111414528 00000100:00100000:3.0:1789048628.703371:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111414528 00000100:00100000:0.0:1789048628.703382:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048628.703395:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1789048628.703404:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111414912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048628.703418:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08a05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111414656:0@lo:400:kworker.0 00000100:00100000:3.0:1789048628.703439:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111414912:12345-0@lo:400:kworker.0 Request processed in 37us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048628.703444:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1789048628.703458:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111414272 00000100:00100000:3.0:1789048628.703461:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111414272 00000100:00100000:0.0:1789048628.703477:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111414144 00000100:00100000:3.0:1789048628.703479:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111414784 00000100:00100000:3.0:1789048628.703485:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111414784 00000100:00100000:0.0:1789048628.703485:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111414144 00000100:00100000:1.0:1789048628.703496:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048628.703507:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111415296 00000100:00100000:3.0:1789048628.703510:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111415296 00000100:00100000:1.0:1789048628.703539:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08a04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111415552:0@lo:400:kworker.0 00000100:00100000:3.0:1789048628.703541:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789048628.703552:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789048628.703558:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111414528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048628.703566:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111414144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048628.703590:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048628.703741:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08a05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111414528:0@lo:400:kworker.0 00000100:00100000:1.0:1789048628.703779:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111415168 00000100:00100000:1.0:1789048628.703785:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111415168 00000100:00100000:1.0:1789048628.703831:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111415040 00000100:00100000:1.0:1789048628.703835:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111415040 00000100:00100000:1.0:1789048628.703851:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111415552 00000100:00100000:1.0:1789048628.703854:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111415552 00000100:00100000:1.0:1789048628.703873:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789048628.703892:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111415168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048628.704803:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111414528:12345-0@lo:400:kworker.0 Request processed in 1239us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048628.704822:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111415168:12345-0@lo:400:kworker.0 Request processed in 925us (2167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048628.704850:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789048628.704858:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1789048628.704909:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789048628.704918:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1789048628.704930:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111414272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048628.704943:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111415040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048628.705005:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111414272:12345-0@lo:400:kworker.0 Request processed in 76us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048628.705012:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789048628.705031:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111415040:12345-0@lo:400:kworker.0 Request processed in 106us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048628.705035:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789048628.705047:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789048628.705054:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111414784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048628.705087:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789048628.705098:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08848380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111415552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048628.705110:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111414784:12345-0@lo:400:kworker.0 Request processed in 58us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048628.705121:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789048628.705147:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1789048628.705155:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08848380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111415552:12345-0@lo:400:kworker.0 Request processed in 57us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048628.705168:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111415296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048628.705177:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789048628.705219:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111415296:12345-0@lo:400:kworker.0 Request processed in 63us (1836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048628.705226:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00080000:3.0:1789048628.705259:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789048628.705263:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789048628.705266:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048628.705268:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048628.705281:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048628.705328:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1789048628.705357:0:3622:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff959c3fba9180, transno 4294967305 00000100:00100000:3.0:1789048628.705484:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111414016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048628.705519:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08a04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111414400:0@lo:400:kworker.0 00010000:00080000:3.0:1789048628.705548:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08a04000 x1875953111414912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048628.705559:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111414912:0@lo:400:kworker.0 00000100:00100000:3.0:1789048628.705769:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111415424 00000100:00100000:3.0:1789048628.705776:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111415424 00000100:00100000:3.0:1789048628.705813:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789048628.705818:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111415424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048628.705859:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111415424:12345-0@lo:400:kworker.0 Request processed in 40us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048628.705864:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00080000:3.0:1789048628.706085:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789048628.706107:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08a07100 x1875953111415424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048628.706118:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08a07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111415424:0@lo:400:kworker.0 00000100:00100000:1.0:1789048628.706568:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08a06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111415040:0@lo:400:kworker.0 00000100:00100000:1.0:1789048628.706588:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08a04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111415552:0@lo:400:kworker.0 00000100:00100000:0.0:1789048628.706738:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3620:x1875953111414144:12345-0@lo:400:kworker.0 Request processed in 3174us (4203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048628.706750:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1789048628.706830:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08a05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111414272:0@lo:400:kworker.0 00000100:00100000:0.0:1789048628.706843:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08a07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111414784:0@lo:400:kworker.0 00000100:00100000:0.0:1789048628.706888:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08a04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111415296:0@lo:400:kworker.0 00000100:00100000:0.0:1789048628.706902:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08a07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111414144:0@lo:400:kworker.0 00000100:00100000:0.0:1789048628.706914:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1789048628.706919:0:3620:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1789048628.706938:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111415168:0@lo:400:kworker.0 00000100:00100000:0.0:1789048628.707068:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789048628.707085:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111415680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048628.707131:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048628.707200:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111415680 00000100:00100000:3.0:1789048628.707207:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111415680 00000100:00100000:3.0:1789048628.707260:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789048628.707269:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2ef2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111415680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789048628.707293:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048628.707365:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2ef2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111415680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048628.707373:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789048628.707393:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111415680:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789048629.215724:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048629.215754:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789048629.215785:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111415808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048629.215935:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048629.216652:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111415808 00000100:00100000:3.0:1789048629.216665:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111415808 00000100:00100000:3.0:1789048629.216734:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789048629.216745:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111415808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789048629.216789:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789048629.216867:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111415808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048629.216885:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789048629.216985:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111415808:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1789048629.333201:0:14439:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 09:57:08 (1789048628) 00000100:00100000:1.0:1789048629.725559:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789048629.725585:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fbaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111415936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789048629.725674:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048629.725786:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111415936 00000100:00100000:3.0:1789048629.725794:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111415936 00000100:00100000:3.0:1789048629.725859:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789048629.725921:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111415936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789048629.725952:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789048629.726003:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111415936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 136us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048629.726010:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789048629.726302:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fbaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111415936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048629.738674:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789048629.738697:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fbaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111416064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048629.738767:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048629.738896:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111416064 00000100:00100000:2.0:1789048629.738905:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111416064 00000100:00100000:2.0:1789048629.738969:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789048629.738979:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111416064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789048629.739002:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789048629.739054:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111416064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048629.739061:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789048629.740013:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fbaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111416064:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789048630.238413:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048630.605955:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048630.606128:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097711744 00000100:00100000:3.0:1789048630.606139:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097711744 00000100:00100000:3.0:1789048630.606237:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 149 00000100:00100000:3.0:1789048630.606250:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+15:12145:x1875953097711744:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789048630.606279:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048630.606302:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087767e7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b298d0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.606420:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087767ee lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.606436:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087767ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.606450:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087767ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.606522:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087767f5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.606530:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087767f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.606537:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087767f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.606634:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c087767fc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.606657:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c087767fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.606665:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c087767fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048630.606676:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789048630.607089:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087767ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.607099:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087767ee lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.607114:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087767ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.607120:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048630.607125:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087767ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.607133:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087767ee lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.607145:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff959c3ef48300) 00010000:00010000:3.0:1789048630.607148:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048630.607154:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087767ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.607160:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c087767ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.607175:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087767f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.607180:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087767f5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.607187:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087767f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.607192:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048630.607194:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087767f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.607210:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087767f5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.607218:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff959b06bfc000) 00010000:00010000:3.0:1789048630.607220:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048630.607223:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087767f5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.607230:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087767f5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.607616:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087767e7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298d0 expref: 18 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.607632:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c087767fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298d0 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048630.607653:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff959c05322a00) 00010000:00010000:3.0:1789048630.607656:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048630.607659:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3ca00, rc 0) 00000100:00100000:3.0:1789048630.607951:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+17:12145:x1875953097711744:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 1704us (2005us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1789048630.607962:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 149 00000100:00080000:0.0:1789048630.608098:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789048630.618745:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048630.618779:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048630.618918:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097712000 00000100:00100000:3.0:1789048630.618928:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097712000 00000100:00100000:3.0:1789048630.618994:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 150 00000100:00100000:3.0:1789048630.619005:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+17:12145:x1875953097712000:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789048630.619134:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+17:12145:x1875953097712000:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 Request processed in 131us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048630.619141:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 150 00000100:00100000:0.0:1789048630.619389:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097711872 00000100:00100000:0.0:1789048630.619394:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097711872 00000100:00100000:0.0:1789048630.619438:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:0.0:1789048630.619445:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c07cf7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+17:2394:x1875953097711872:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048630.619455:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048630.619479:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c087767fc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298d0 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048630.619498:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff959c05322a00) 00010000:00010000:0.0:1789048630.619502:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048630.619532:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c07cf7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:2394:x1875953097711872:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 87us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048630.619539:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:1.0:1789048630.622891:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048630.623448:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097712128 00000100:00100000:0.0:1789048630.623457:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097712128 00000100:00100000:0.0:1789048630.623571:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 151 00000100:00100000:0.0:1789048630.623582:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:12145:x1875953097712128:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789048630.623895:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:12145:x1875953097712128:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 Request processed in 314us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048630.624442:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 151 00000100:00080000:3.0:1789048630.626706:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789048630.750896:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111416192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048630.750975:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048630.751049:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111416192 00000100:00100000:3.0:1789048630.751058:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111416192 00000100:00100000:3.0:1789048630.751136:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789048630.751147:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111416192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789048630.751181:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789048630.751246:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111416192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048630.751266:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789048630.754667:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111416192:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1789048630.943222:0:13781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789048631.262584:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789048631.453523:0:13779:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789048631.453533:0:13779:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789048631.454184:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789048631.454197:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789048632.285509:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048632.386555:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048632.386598:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048632.386623:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048632.386660:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048632.386687:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048632.386708:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048632.386735:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048632.386765:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097712256 00000100:00100000:2.0:1789048632.386788:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097712256 00000100:00100000:2.0:1789048632.386851:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 398 00000100:00100000:2.0:1789048632.386861:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2392:x1875953097712256:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048632.387301:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2392:x1875953097712256:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 440us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048632.387309:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 398 00000100:00100000:2.0:1789048632.387453:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097712384 00000100:00100000:2.0:1789048632.387458:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097712384 00000100:00100000:2.0:1789048632.387499:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097712896 00000100:00100000:2.0:1789048632.387503:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097712896 00000100:00100000:2.0:1789048632.387518:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097712512 00000100:00100000:2.0:1789048632.387521:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097712512 00000100:00100000:2.0:1789048632.387536:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097713024 00000100:00100000:2.0:1789048632.387539:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097713024 00000100:00100000:2.0:1789048632.387555:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 331 00000100:00100000:2.0:1789048632.387562:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fbab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:2392:x1875953097712384:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048632.387598:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fbab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:2392:x1875953097712384:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 37us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048632.387605:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 331 00000100:00100000:2.0:1789048632.387620:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 332 00000100:00100000:2.0:1789048632.387625:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fbab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2392:x1875953097712896:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048632.387647:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fbab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2392:x1875953097712896:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 22us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048632.387653:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 332 00000100:00100000:2.0:1789048632.387666:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 333 00000100:00100000:2.0:1789048632.387673:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2392:x1875953097712512:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048632.387711:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2392:x1875953097712512:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 39us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048632.387717:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 333 00000100:00100000:2.0:1789048632.387730:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 334 00000100:00100000:2.0:1789048632.387737:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fbab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2392:x1875953097713024:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048632.387759:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fbab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2392:x1875953097713024:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 22us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048632.387765:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 334 00000100:00100000:2.0:1789048632.387788:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097712640 00000100:00100000:2.0:1789048632.387792:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097712640 00000100:00100000:2.0:1789048632.387820:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097712768 00000100:00100000:2.0:1789048632.387824:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097712768 00000100:00100000:2.0:1789048632.387859:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 120 00000100:00100000:2.0:1789048632.387866:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2392:x1875953097712640:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048632.388011:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 121 00000100:00100000:1.0:1789048632.388022:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fbaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2392:x1875953097712768:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048632.388049:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fbaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2392:x1875953097712768:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 30us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048632.388054:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 121 00000100:00100000:2.0:1789048632.388524:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2392:x1875953097712640:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 657us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048632.388531:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 120 00000100:00080000:2.0:1789048632.389168:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789048632.389173:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789048632.389177:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789048632.389179:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789048632.655198:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048632.655291:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097713152 00000100:00100000:3.0:1789048632.655302:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097713152 00000100:00100000:3.0:1789048632.655384:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 152 00000100:00100000:3.0:1789048632.655395:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:12186:x1875953097713152:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789048632.655416:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048632.655436:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877680a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b298d7 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655494:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776811 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655509:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776811 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655532:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776811 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655547:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776818 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655554:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655561:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655603:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776811 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655611:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776811 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655617:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776811 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655623:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048632.655627:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776811 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655634:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776811 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655646:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c02b11400) 00010000:00010000:3.0:1789048632.655649:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048632.655654:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776811 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655666:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776811 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655678:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655684:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776818 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655690:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776818 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655694:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048632.655697:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776818 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655704:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776818 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655711:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff959b06bfcd00) 00010000:00010000:3.0:1789048632.655713:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048632.655716:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776818 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655721:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776818 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655751:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877680a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298d7 expref: 17 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655772:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c02b11400) 00010000:00010000:3.0:1789048632.655774:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048632.655778:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877680a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298d7 expref: 17 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.655787:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3c400, rc 0) 00000100:00100000:3.0:1789048632.655854:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:12186:x1875953097713152:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 461us (664us total) trans 0 rc 301/301 00000100:00100000:3.0:1789048632.655861:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 152 00000100:00100000:2.0:1789048632.666796:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048632.666910:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097713408 00000100:00100000:3.0:1789048632.666921:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097713408 00000100:00100000:3.0:1789048632.666982:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 153 00000100:00100000:3.0:1789048632.666993:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fbaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+16:12186:x1875953097713408:12345-192.168.202.16@tcp:36:lfs.0 00010000:00010000:3.0:1789048632.667051:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048632.667081:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c0877616c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29702 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.667100:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c02b11400) 00010000:00010000:3.0:1789048632.667110:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789048632.667174:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877681f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.667188:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877681f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.667198:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877681f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.667228:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776826 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.667235:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776826 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.667241:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776826 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.667868:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877682d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.667879:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877682d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.667887:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877682d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789048632.667902:0:6497:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000007e6c90f6 reply state 00000000c357a68e transno 4294967422 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877682d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.667912:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877682d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.667917:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959b06bfc600) 00010000:00010000:3.0:1789048632.667921:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789048632.667925:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789048632.667930:0:6497:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789048632.667936:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877681f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.667942:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877681f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.667955:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877681f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.667961:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048632.667965:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877681f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.667972:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877681f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.667981:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfcd00) 00010000:00010000:3.0:1789048632.667983:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048632.667986:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877681f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.667993:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877681f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789048632.668006:0:6497:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000007e6c90f6 reply state 00000000c357a68e transno 4294967422 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776826 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.668014:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776826 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.668020:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff959b06bfc200) 00010000:00010000:3.0:1789048632.668022:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789048632.668024:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789048632.668098:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fbaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+17:12186:x1875953097713408:12345-192.168.202.16@tcp:36:lfs.0 Request processed in 1105us (1313us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1789048632.668107:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 153 00000001:00080000:1.0:1789048632.671665:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967422 is committed 00000020:00080000:1.0:1789048632.671684:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1789048632.671742:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1789048632.671753:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1789048632.671797:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776826 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.671810:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776826 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.671818:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776826 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.671824:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048632.671829:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776826 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.671846:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776826 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.671863:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff959b06bfc200) 00010000:00010000:3.0:1789048632.671866:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048632.671872:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776826 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.671878:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08776826 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.671896:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877682d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.671901:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877682d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.671907:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877682d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.671922:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048632.671926:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877682d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.671931:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877682d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.671938:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959b06bfc600) 00010000:00010000:3.0:1789048632.671940:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048632.671943:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877682d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.671948:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c0877682d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048632.794504:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048632.797459:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097713536 00000100:00100000:3.0:1789048632.797476:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097713536 00000100:00100000:3.0:1789048632.797789:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 154 00000100:00100000:3.0:1789048632.797802:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+13:12195:x1875953097713536:12345-192.168.202.16@tcp:101:lctl.0 00010000:00010000:3.0:1789048632.797830:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048632.797864:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776834 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b298de expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.797928:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c0877683b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.797942:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c0877683b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.797955:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c0877683b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048632.798015:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789048632.798019:0:6498:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789048632.798046:0:6498:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c0877683b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.798072:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776834 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298de expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.798105:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c0877683b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298de expref: 14 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048632.798114:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfc600) 00010000:00010000:3.0:1789048632.798117:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789048632.798120:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3c800, rc 0) 00000100:00100000:3.0:1789048632.798187:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:12195:x1875953097713536:12345-192.168.202.16@tcp:101:lctl.0 Request processed in 388us (3695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048632.798194:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 154 00000100:00100000:2.0:1789048632.879667:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048632.879999:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097713664 00000100:00100000:0.0:1789048632.880015:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097713664 00000100:00100000:0.0:1789048632.881184:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 155 00000100:00100000:0.0:1789048632.881207:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+14:12201:x1875953097713664:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048632.881245:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048632.881277:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776842 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b298e5 expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.881649:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776849 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.881668:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776849 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.881684:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776849 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.881779:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776850 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.881789:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776850 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.881798:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776850 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.882064:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776857 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.882074:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776857 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.882082:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776857 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048632.882133:0:8649:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789048632.882136:0:8649:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789048632.882174:0:8649:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776857 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.882203:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776849 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.882209:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776849 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.882217:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776849 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.882608:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048632.882615:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776849 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.882626:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776849 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.882644:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfc600) 00010000:00010000:0.0:1789048632.882647:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048632.882654:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776849 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.882661:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776849 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.882679:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776850 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.882686:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776850 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.882693:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776850 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.882857:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048632.882861:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776850 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.882868:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776850 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.882878:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff959c4151a600) 00010000:00010000:0.0:1789048632.882881:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048632.882961:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776850 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.882970:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776850 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.883023:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776842 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298e5 expref: 16 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.883040:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776857 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298e5 expref: 15 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048632.883047:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:0.0:1789048632.883050:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789048632.883053:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39800, rc 0) 00000100:00100000:0.0:1789048632.883799:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+15:12201:x1875953097713664:12345-192.168.202.16@tcp:101:bash.0 Request processed in 2595us (4143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048632.883812:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 155 00000100:00100000:1.0:1789048632.888735:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048632.889144:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097713920 00000100:00100000:2.0:1789048632.889159:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097713920 00000100:00100000:2.0:1789048632.889411:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 156 00000100:00100000:2.0:1789048632.889425:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+15:12201:x1875953097713920:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789048632.889456:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048632.889489:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c0877685e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b298ec expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.889809:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776865 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.889828:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776865 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.889856:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776865 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.890107:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c0877686c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.890132:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c0877686c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.890145:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c0877686c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789048632.890584:0:12131:0:(osp_object.c:1667:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1789048632.890747:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776873 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.890778:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776873 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.890785:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776873 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.890820:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776865 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.890828:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776865 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.890844:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776865 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.890850:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048632.890854:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776865 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.890861:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776865 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.890872:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:2.0:1789048632.892266:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048632.892277:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776865 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.892286:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776865 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789048632.892306:0:12131:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000009025c319 reply state 00000000fed46c1f transno 4294967423 ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c0877686c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.892381:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c0877686c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.892389:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959c02b11400) 00010000:00010000:2.0:1789048632.892391:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789048632.892395:0:12131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789048632.892453:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c0877685e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298ec expref: 18 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.892470:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776873 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298ec expref: 17 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.892477:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c02b11700) 00010000:00010000:2.0:1789048632.892480:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789048632.892482:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb0600, rc 0) 00000100:00100000:2.0:1789048632.892578:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+18:12201:x1875953097713920:12345-192.168.202.16@tcp:101:bash.0 Request processed in 3152us (3856us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1789048632.892589:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 156 00000100:00100000:2.0:1789048632.901113:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048632.901265:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097714048 00000100:00100000:1.0:1789048632.901289:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097714048 00000100:00100000:1.0:1789048632.901378:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:1.0:1789048632.901388:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fbabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097714048:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1789048632.901411:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048632.901441:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08776881 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b298f3 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789048632.901474:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048632.901500:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=387s v=(0 0) 00010000:00010000:1.0:1789048632.901505:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048632.901515:0:8412:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08776881 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298f3 expref: 6 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048632.901536:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08776881 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298f3 expref: 6 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048632.901550:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1200, rc 0) 00000100:00100000:1.0:1789048632.901628:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fbabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2394:x1875953097714048:12345-192.168.202.16@tcp:101:bash.0 Request processed in 242us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048632.901637:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:0.0:1789048632.907484:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048632.908219:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097714176 00000100:00100000:2.0:1789048632.908230:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097714176 00000100:00100000:2.0:1789048632.908299:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:2.0:1789048632.908310:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:12201:x1875953097714176:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789048632.908328:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048632.908383:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001947c6d/0x133f221c08776888 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b298fa expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.908433:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08776881 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298f3 expref: 7 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.908446:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048632.908450:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048632.908454:0:8413:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001947c6d/0x133f221c08776888 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298fa expref: 7 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.908489:0:8413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08776881 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b298f3 expref: 7 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.908502:0:8413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08776881 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b298f3 expref: 7 pid: 8412 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048632.908516:0:8413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fbaa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1875953111416320:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789048632.913194:0:8413:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef21840 going to sleep for 11 seconds 00000100:00100000:2.0:1789048632.915405:0:8413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fbaa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1875953111416320:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789048632.915450:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000001947c6d/0x133f221c08776888 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b298fa expref: 7 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.915476:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb0e00, rc 0) 00000100:00100000:2.0:1789048632.915549:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:12201:x1875953097714176:12345-192.168.202.16@tcp:101:bash.0 Request processed in 7239us (8076us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048632.915559:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:0.0:1789048632.919472:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048632.919559:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097714304 00000100:00100000:2.0:1789048632.919568:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097714304 00010000:00010000:2.0:1789048632.919605:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08776881 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b298f3 expref: 7 pid: 8412 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048632.919639:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 80 00000100:00100000:2.0:1789048632.919646:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2393:x1875953097714304:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048632.919658:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048632.919677:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08776881 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b298f3 expref: 7 pid: 8412 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.919688:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08776881 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b298f3 expref: 7 pid: 8412 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.919705:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08776881 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b298f3 expref: 7 pid: 8412 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.919719:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048632.919722:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048632.919727:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001947c6d/0x133f221c08776888 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b298fa expref: 6 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.919734:0:6483:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001947c6d/0x133f221c08776888 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b298fa expref: 6 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048632.919762:0:6483:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000001947c6d/0x133f221c08776888 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b298fa expref: 6 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048632.919784:0:6483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fbaa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6483:1875953111416448:192.168.202.16@tcp:105: 00000100:00100000:2.0:1789048632.919858:0:6483:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef21840 going to sleep for 11 seconds 00000100:00100000:0.0:1789048632.929419:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048632.929531:0:6483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fbaa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6483:1875953111416448:192.168.202.16@tcp:105: 00010000:00010000:2.0:1789048632.929556:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048632.929615:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097714304:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 9967us (10150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048632.929626:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 80 00000100:00100000:1.0:1789048632.930038:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097714560 00000100:00100000:1.0:1789048632.930045:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097714560 00000100:00100000:1.0:1789048632.930091:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:1.0:1789048632.930101:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+18:12201:x1875953097714560:12345-192.168.202.16@tcp:35:bash.0 00000001:00080000:1.0:1789048632.930317:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000100:00100000:1.0:1789048632.930430:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:12201:x1875953097714560:12345-192.168.202.16@tcp:35:bash.0 Request processed in 330us (1022us total) trans 4294967425 rc 0/0 00000100:00100000:1.0:1789048632.930453:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 36 00000020:00080000:1.0:1789048632.930457:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789048633.018600:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048633.018771:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097714816 00000100:00100000:0.0:1789048633.018786:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097714816 00000100:00100000:0.0:1789048633.018872:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 157 00000100:00100000:0.0:1789048633.018884:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:12211:x1875953097714816:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789048633.018914:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048633.018943:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c0877688f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29901 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048633.019209:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789048633.020463:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c0877688f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29901 expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.020489:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfc600) 00010000:00010000:1.0:1789048633.020492:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789048633.020499:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c0877688f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29901 expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.020518:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39a00, rc 0) 00000100:00100000:1.0:1789048633.020676:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+21:12211:x1875953097714816:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1792us (2462us total) trans 4294967426 rc 301/301 00000100:00100000:1.0:1789048633.020688:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 157 00000100:00100000:0.0:1789048633.024541:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048633.024707:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097715072 00000100:00100000:2.0:1789048633.024721:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097715072 00000100:00100000:2.0:1789048633.024841:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:2.0:1789048633.024854:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+21:12211:x1875953097715072:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789048633.025432:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+22:12211:x1875953097715072:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 578us (905us total) trans 4294967427 rc 0/0 00000100:00100000:2.0:1789048633.025442:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:0.0:1789048633.112892:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048633.113008:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097715200 00000100:00100000:1.0:1789048633.113023:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097715200 00000100:00100000:1.0:1789048633.113111:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 158 00000100:00100000:1.0:1789048633.113123:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+22:12217:x1875953097715200:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789048633.113157:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048633.113199:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877689d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29908 expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.113295:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087768a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.113313:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087768a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.113393:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087768a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048633.113455:0:8649:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789048633.113459:0:8649:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789048633.113484:0:8649:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087768a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.113517:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877689d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29908 expref: 24 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.113541:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087768a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29908 expref: 23 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.113552:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:1.0:1789048633.113555:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789048633.113559:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0c00, rc 0) 00000100:00100000:1.0:1789048633.113631:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+23:12217:x1875953097715200:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 509us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048633.113639:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 158 00000100:00100000:1.0:1789048633.121821:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048633.121953:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097715456 00000100:00100000:2.0:1789048633.121966:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097715456 00000100:00100000:2.0:1789048633.122049:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 159 00000100:00100000:2.0:1789048633.122072:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+23:12217:x1875953097715456:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048633.122102:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048633.122134:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087768ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2990f expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.122296:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c087768b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.122379:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c087768b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.122398:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c087768b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048633.122415:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789048633.122574:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087768ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2990f expref: 26 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.122595:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c087768b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2990f expref: 25 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.122604:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c02b11700) 00010000:00010000:2.0:1789048633.122607:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789048633.122611:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb0200, rc 0) 00000100:00100000:2.0:1789048633.122898:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+25:12217:x1875953097715456:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 828us (1091us total) trans 4294967428 rc 0/0 00000100:00100000:2.0:1789048633.122908:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 159 00000100:00100000:0.0:1789048633.127868:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048633.128100:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097715584 00000100:00100000:2.0:1789048633.128120:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097715584 00000100:00100000:2.0:1789048633.128443:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:2.0:1789048633.128459:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+25:2392:x1875953097715584:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048633.128484:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048633.128519:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c087768b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2990f expref: 25 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.128568:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c02b11700) 00010000:00010000:2.0:1789048633.128575:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048633.128693:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+24:2392:x1875953097715584:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 238us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048633.128701:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:1.0:1789048633.139991:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048633.140314:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097715840 00000100:00100000:2.0:1789048633.140327:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097715840 00000100:00100000:2.0:1789048633.140436:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 160 00000100:00100000:2.0:1789048633.140449:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+24:12217:x1875953097715840:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048633.140482:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048633.140509:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087768c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29916 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.140684:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c087768c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.140704:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c087768c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.140719:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c087768c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048633.140735:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789048633.140885:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087768c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29916 expref: 27 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.140908:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c087768c7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29916 expref: 26 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.140927:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c02b11700) 00010000:00010000:2.0:1789048633.140931:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789048633.140935:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb1e00, rc 0) 00000100:00100000:2.0:1789048633.141009:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+26:12217:x1875953097715840:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 561us (1033us total) trans 4294967429 rc 0/0 00000100:00100000:2.0:1789048633.141016:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 160 00000100:00100000:0.0:1789048633.150316:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048633.150465:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097715968 00000100:00100000:1.0:1789048633.150479:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097715968 00000100:00100000:1.0:1789048633.150572:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:1.0:1789048633.150586:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097715968:12345-192.168.202.16@tcp:1:lfs.0 00010000:00010000:1.0:1789048633.150655:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087768d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.150705:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000001947c6d/0x133f221c08776888 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b298fa expref: 6 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.150715:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048633.150720:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789048633.150725:0:8412:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087768d5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.150775:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000001947c6d/0x133f221c08776888 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0xd796648991b298fa expref: 6 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.150794:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000001947c6d/0x133f221c08776888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b298fa expref: 6 pid: 8413 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048633.150813:0:8412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1875953111416576:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789048633.151127:0:8412:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3e87e180 going to sleep for 11 seconds 00000100:00100000:0.0:1789048633.155239:0:8412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1875953111416576:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048633.155283:0:8412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087768d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048633.155783:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048633.155869:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097716096 00000100:00100000:0.0:1789048633.155888:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097716096 00002000:00100000:0.0:1789048633.155953:0:8417:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff959b08925f80 x1875953097716096/t0(0) o4->85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp:644/0 lens 504/0 e 0 to 0 dl 1789048644 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789048633.155963:0:8417:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b08925f80 with x1875953097716096 ext(0->12) 00010000:00010000:0.0:1789048633.155971:0:8417:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000001947c6d/0x133f221c08776888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b298fa expref: 7 pid: 8413 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.156005:0:8417:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000001947c6d/0x133f221c08776888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b298fa expref: 7 pid: 8413 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789048633.156014:0:8417:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff959b08925f80 00000100:00100000:3.0:1789048633.156193:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:3.0:1789048633.156208:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08925f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2394:x1875953097716096:12345-192.168.202.16@tcp:4:lfs.0 00000100:00100000:2.0:1789048633.158682:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08925f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:2394:x1875953097716096:12345-192.168.202.16@tcp:4:lfs.0 Request processed in 2464us (2887us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789048633.158701:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00002000:00100000:2.0:1789048633.158717:0:8419:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff959b08925f80 x1875953097716096/t4294967306(0) o4->85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp:644/0 lens 504/448 e 0 to 0 dl 1789048644 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789048633.158729:0:8419:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b08925f80 with x1875953097716096 ext(0->12) 00010000:00010000:2.0:1789048633.158741:0:8419:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000001947c6d/0x133f221c08776888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b298fa expref: 9 pid: 8413 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.158764:0:8419:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000001947c6d/0x133f221c08776888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b298fa expref: 9 pid: 8413 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789048633.158774:0:8419:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff959b08925f80 00000100:00100000:1.0:1789048633.161459:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048633.161561:0:13167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097716224 00000100:00100000:0.0:1789048633.161575:0:13167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097716224 00010000:00010000:0.0:1789048633.161633:0:13167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001947c6d/0x133f221c08776888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b298fa expref: 9 pid: 8413 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048633.161690:0:13167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00100000:0.0:1789048633.161702:0:13167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:2393:x1875953097716224:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048633.161722:0:13167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789048633.161747:0:13167:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789048633.161751:0:13167:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789048633541065621 00002000:00010000:0.0:1789048633.161754:0:13167:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789048633758647218 00002000:00010000:0.0:1789048633.161757:0:13167:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789048633541065621 00002000:00010000:0.0:1789048633.161759:0:13167:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789048633.161765:0:13167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001947c6d/0x133f221c08776888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b298fa expref: 9 pid: 8413 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.161781:0:13167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001947c6d/0x133f221c08776888 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b298fa expref: 9 pid: 8413 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.161815:0:13167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001947c6d/0x133f221c08776888 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b298fa expref: 9 pid: 8413 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.161907:0:13167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789048633.161912:0:13167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789048633.161920:0:13167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087768d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.161933:0:13167:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087768d5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.161976:0:13167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048633.162045:0:13167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2393:x1875953097716224:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 344us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048633.162053:0:13167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 81 00010000:00010000:1.0:1789048633.162196:0:8412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087768d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.162208:0:8412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087768d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.162235:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087768d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.162258:0:8412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087768d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.162267:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087768d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.162275:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0800 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048633.162280:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087768d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.162290:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087768d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.162305:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087768d5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.162314:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007013a391/0x133f221c087768d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048633.162409:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2393:x1875953097715968:12345-192.168.202.16@tcp:1:lfs.0 Request processed in 11827us (12111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048633.162419:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:0.0:1789048633.166783:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048633.166925:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097716480 00000100:00100000:3.0:1789048633.166940:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097716480 00000100:00100000:3.0:1789048633.167010:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:3.0:1789048633.167022:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b2a9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+26:12217:x1875953097716480:12345-192.168.202.16@tcp:35:lfs.0 00000004:00010000:3.0:1789048633.167114:0:6500:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c087768c7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29916 expref: 26 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789048633.167775:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000001:00080000:3.0:1789048633.167820:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000001:00080000:2.0:1789048633.169582:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1789048633.169685:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087768dc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.169712:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776873 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298ec expref: 30 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.169746:0:6500:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087768dc lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.169802:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776873 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b298ec expref: 30 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.169824:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776873 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b298ec expref: 30 pid: 12131 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048633.169856:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fbaa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6500:1875953111416704:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789048633.170266:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef21c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789048633.173978:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048633.174074:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097716608 00000100:00100000:0.0:1789048633.174087:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097716608 00010000:00010000:0.0:1789048633.174145:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776873 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b298ec expref: 31 pid: 12131 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048633.174204:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 82 00000100:00100000:0.0:1789048633.174217:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08925180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+31:2394:x1875953097716608:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048633.174236:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048633.174245:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776873 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b298ec expref: 31 pid: 12131 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.174260:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776873 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b298ec expref: 31 pid: 12131 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.174311:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c02b11700) 00010000:00010000:0.0:1789048633.174317:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087768dc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.174328:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087768dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.174382:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087768dc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.174407:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048633.174476:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08925180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+31:2394:x1875953097716608:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 261us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048633.174484:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 82 00010000:00010000:2.0:1789048633.176149:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776873 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b298ec expref: 30 pid: 12131 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048633.176245:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fbaa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6500:1875953111416704:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789048633.176278:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087768dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.176291:0:6500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087768dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.176298:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087768dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789048633.176554:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00000001:00080000:2.0:1789048633.176707:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967434 00000100:00100000:2.0:1789048633.176827:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fbaa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1875953111416832:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789048633.176952:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048633.177069:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef21300 going to sleep for 11 seconds 00000100:00100000:1.0:1789048633.177681:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111416832 00000100:00100000:1.0:1789048633.177691:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111416832 00000100:00100000:1.0:1789048633.177808:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789048633.177841:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6500:x1875953111416832:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789048633.177995:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6500:x1875953111416832:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 166us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048633.178004:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789048633.178227:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fbaa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1875953111416832:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789048633.178441:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967435 00000100:00100000:0.0:1789048633.178523:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08a07100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1875953111416960:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789048633.178567:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048633.178604:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3e600 going to sleep for 11 seconds 00000100:00100000:3.0:1789048633.178735:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111416960 00000100:00100000:3.0:1789048633.178742:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111416960 00000100:00100000:3.0:1789048633.178790:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789048633.178799:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6500:x1875953111416960:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789048633.178953:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6500:x1875953111416960:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 155us (384us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789048633.178960:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789048633.179288:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08a07100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1875953111416960:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789048633.179383:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967436 00010000:00010000:0.0:1789048633.179429:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087768dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.179441:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087768dc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.179449:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087768dc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.179471:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048633.179477:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087768dc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.179487:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087768dc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.179509:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c02b11700) 00010000:00010000:0.0:1789048633.179512:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789048633.179517:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087768dc lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.179525:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c087768dc lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789048633.179655:0:6500:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789048633.179733:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1789048633.179748:0:6500:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 387933414155ns, next at 388933410776ns, rc = 0 00000001:00080000:0.0:1789048633.179755:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967437 00010000:00010000:0.0:1789048633.179780:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c02b11700) 00010000:00010000:0.0:1789048633.179783:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789048633.179791:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c087768c7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29916 expref: 34 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048633.179931:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b2a9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+33:12217:x1875953097716480:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 12909us (13164us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1789048633.179941:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 38 00000020:00080000:0.0:1789048633.179946:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789048633.182777:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048633.182956:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097716736 00000100:00100000:0.0:1789048633.182968:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097716736 00000100:00100000:0.0:1789048633.183092:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 161 00000100:00100000:0.0:1789048633.183106:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+33:12217:x1875953097716736:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789048633.183139:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048633.183179:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087768e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2991d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.183275:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087768e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2991d expref: 34 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.183294:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087768e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2991d expref: 34 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.183317:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:0.0:1789048633.183320:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789048633.183325:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39a00, rc 0) 00000100:00100000:0.0:1789048633.183412:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+34:12217:x1875953097716736:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 309us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048633.183420:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 161 00000100:00080000:2.0:1789048633.183782:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789048633.188180:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048633.188270:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097716992 00000100:00100000:2.0:1789048633.188284:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097716992 00000100:00100000:2.0:1789048633.188397:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:2.0:1789048633.188410:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+34:12217:x1875953097716992:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789048633.188740:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+35:12217:x1875953097716992:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 331us (583us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789048633.188749:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:1.0:1789048633.288416:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048633.288540:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097717248 00000100:00100000:2.0:1789048633.288555:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097717248 00000100:00100000:2.0:1789048633.288639:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 162 00000100:00100000:2.0:1789048633.288653:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+35:12227:x1875953097717248:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048633.288689:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048633.288717:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c087768ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29924 expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048633.288864:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789048633.289012:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c087768ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29924 expref: 37 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.289029:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfc600) 00010000:00010000:2.0:1789048633.289033:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789048633.289040:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c087768ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29924 expref: 37 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.289083:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb0600, rc 0) 00000100:00100000:2.0:1789048633.289170:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+36:12227:x1875953097717248:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 518us (768us total) trans 4294967440 rc 301/301 00000100:00100000:2.0:1789048633.289178:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 162 00000100:00100000:3.0:1789048633.294904:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048633.295720:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097717376 00000100:00100000:0.0:1789048633.295736:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097717376 00000100:00100000:0.0:1789048633.295887:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 163 00000100:00100000:0.0:1789048633.295900:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+36:12227:x1875953097717376:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:0.0:1789048633.296017:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c087768f8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296039:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c087768f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296076:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c087768f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296089:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087768ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296097:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087768ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296105:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087768ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296233:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776906 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296243:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296250:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789048633.296316:0:8649:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296355:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c087768f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296363:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c087768f8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296371:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c087768f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296387:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048633.296393:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c087768f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296402:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c087768f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296417:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:0.0:1789048633.296421:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048633.296426:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c087768f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296433:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c087768f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296758:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087768ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296765:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087768ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296772:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087768ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296777:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048633.296780:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087768ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296787:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087768ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296809:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959c02b11400) 00010000:00010000:0.0:1789048633.296812:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048633.296815:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087768ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296822:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087768ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296842:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296848:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776906 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296854:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776906 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296858:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048633.296862:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776906 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296867:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776906 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296874:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:0.0:1789048633.296876:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048633.296879:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776906 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.296884:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776906 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048633.297139:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+36:12227:x1875953097717376:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 1237us (2257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048633.297151:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 163 00000100:00100000:1.0:1789048633.304266:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048633.304474:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097717632 00000100:00100000:2.0:1789048633.304488:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097717632 00000100:00100000:2.0:1789048633.304709:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:2.0:1789048633.304722:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+36:12227:x1875953097717632:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789048633.307128:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+37:12227:x1875953097717632:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 2392us (2862us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1789048633.307146:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 40 00010000:00010000:2.0:1789048633.311406:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048633.362196:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048633.362330:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097717888 00000100:00100000:0.0:1789048633.362390:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097717888 00000100:00100000:0.0:1789048633.362474:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 164 00000100:00100000:0.0:1789048633.362487:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+37:12230:x1875953097717888:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789048633.362522:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048633.362551:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c0877690d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2992b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.362663:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776914 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.362681:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776914 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.362700:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776914 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.362713:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877691b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.362721:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877691b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.362728:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877691b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.362906:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776922 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.362916:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776922 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.362924:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776922 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048633.362937:0:6499:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789048633.363039:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776914 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.363049:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776914 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.363057:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776914 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.363062:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048633.363067:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776914 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.363075:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776914 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.363089:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:0.0:1789048633.363092:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048633.363098:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776914 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.363118:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776914 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.363136:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877691b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.363142:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877691b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.363147:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877691b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.363152:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048633.363154:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877691b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.363160:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877691b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.363168:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959c02b11400) 00010000:00010000:0.0:1789048633.363171:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048633.363174:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877691b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.363180:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877691b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.363224:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c0877690d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2992b expref: 40 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.363241:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776922 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2992b expref: 39 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.363256:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:0.0:1789048633.363259:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048633.363262:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39000, rc 0) 00000100:00100000:0.0:1789048633.363405:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+39:12230:x1875953097717888:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 920us (1224us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1789048633.363415:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 164 00000100:00100000:0.0:1789048633.370104:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048633.371274:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097718016 00000100:00100000:1.0:1789048633.371292:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097718016 00000100:00100000:1.0:1789048633.371438:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 165 00000100:00100000:1.0:1789048633.371451:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+39:12230:x1875953097718016:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:1.0:1789048633.371577:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776930 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.371610:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776930 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.371626:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776930 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.371675:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776930 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.371684:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776930 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.371692:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776930 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.371723:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048633.371728:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776930 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.371736:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776930 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.371751:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:1.0:1789048633.371754:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789048633.371760:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776930 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048633.371766:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776930 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048633.371893:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+39:12230:x1875953097718016:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 444us (1806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048633.371902:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 165 00000100:00100000:0.0:1789048633.375278:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048633.375389:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097718272 00000100:00100000:2.0:1789048633.375403:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097718272 00000100:00100000:2.0:1789048633.375480:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:2.0:1789048633.375493:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+39:12230:x1875953097718272:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789048633.375869:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+40:12230:x1875953097718272:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 378us (606us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1789048633.375886:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:2.0:1789048633.660085:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048633.660736:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097718528 00000100:00100000:0.0:1789048633.660750:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097718528 00000100:00100000:0.0:1789048633.660849:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 166 00000100:00100000:0.0:1789048633.660864:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fbaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+40:12261:x1875953097718528:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:0.0:1789048633.660972:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048633.661003:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776937 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29932 expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.661741:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c0877693e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.661765:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c0877693e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.661781:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c0877693e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048633.661800:0:8649:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789048633.662053:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776937 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29932 expref: 43 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.662096:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c0877693e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29932 expref: 42 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.662106:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:0.0:1789048633.662110:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048633.662114:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38e00, rc 0) 00000100:00100000:0.0:1789048633.663233:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fbaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+42:12261:x1875953097718528:12345-192.168.202.16@tcp:101:cat.0 Request processed in 2362us (3155us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1789048633.663248:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 166 00000100:00100000:0.0:1789048633.669627:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048633.671185:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097718784 00000100:00100000:2.0:1789048633.671205:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097718784 00000100:00100000:2.0:1789048633.671317:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:2.0:1789048633.671372:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+42:12261:x1875953097718784:12345-192.168.202.16@tcp:35:cat.0 00000100:00100000:2.0:1789048633.671842:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+43:12261:x1875953097718784:12345-192.168.202.16@tcp:35:cat.0 Request processed in 512us (2229us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1789048633.671851:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:1.0:1789048633.681178:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048633.681456:0:13167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097718912 00000100:00100000:0.0:1789048633.681469:0:13167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097718912 00000100:00100000:0.0:1789048633.681572:0:13167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:0.0:1789048633.681586:0:13167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07959500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+43:2394:x1875953097718912:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048633.681609:0:13167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048633.682036:0:13167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c0877693e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29932 expref: 43 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.682069:0:13167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:0.0:1789048633.682075:0:13167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048633.682215:0:13167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07959500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+42:2394:x1875953097718912:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 630us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048633.682224:0:13167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:1.0:1789048633.748977:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048633.749391:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097719168 00000100:00100000:2.0:1789048633.749405:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097719168 00000100:00100000:2.0:1789048633.749492:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 167 00000100:00100000:2.0:1789048633.749503:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+42:12267:x1875953097719168:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1789048633.749537:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048633.749541:0:12131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789048633.749577:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c087768a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29908 expref: 42 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.749601:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:2.0:1789048633.749607:0:12131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789048633.749627:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c0877694c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29939 expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.749782:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776953 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.749799:0:12131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776922 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2992b expref: 42 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.749809:0:12131:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776953 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.749881:0:12131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776922 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2992b expref: 42 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.749924:0:12131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776922 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2992b expref: 42 pid: 6499 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048633.749962:0:12131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12131:1875953111417088:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789048633.750092:0:12131:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c012edb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789048633.752763:0:12131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12131:1875953111417088:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789048633.752814:0:12131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776953 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048633.753215:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048633.753562:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097719296 00000100:00100000:0.0:1789048633.753574:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097719296 00010000:00010000:0.0:1789048633.753764:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776922 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2992b expref: 43 pid: 6499 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048633.753886:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 83 00000100:00100000:0.0:1789048633.753900:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07958a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+43:2394:x1875953097719296:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048633.753920:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048633.753938:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776922 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2992b expref: 43 pid: 6499 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.753959:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776922 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2992b expref: 43 pid: 6499 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.753990:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776922 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2992b expref: 43 pid: 6499 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.754011:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:0.0:1789048633.754017:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776953 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.754029:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776953 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.754039:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776953 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.754084:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048633.754162:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07958a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+42:2394:x1875953097719296:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 265us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048633.754170:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 83 00010000:00010000:2.0:1789048633.754247:0:12131:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776953 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.754256:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776953 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048633.754283:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789048633.754502:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c0877694c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29939 expref: 43 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.754519:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776953 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29939 expref: 42 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.754527:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:2.0:1789048633.754530:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789048633.754533:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb1000, rc 0) 00000100:00100000:2.0:1789048633.754580:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+42:12267:x1875953097719168:12345-192.168.202.16@tcp:101:dd.0 Request processed in 5079us (5619us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789048633.754596:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 167 00000100:00100000:1.0:1789048633.756643:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048633.756759:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097719424 00000100:00100000:2.0:1789048633.756772:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097719424 00000100:00100000:2.0:1789048633.756853:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 168 00000100:00100000:2.0:1789048633.756864:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0795aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+42:12267:x1875953097719424:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1789048633.756939:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048633.756966:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c08776961 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29940 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.757101:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776968 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.757117:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776968 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.757128:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776968 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.761455:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c08776961 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29940 expref: 44 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.761499:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776968 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29940 expref: 43 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048633.761510:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:2.0:1789048633.761514:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789048633.761518:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb1200, rc 0) 00000100:00100000:2.0:1789048633.761617:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0795aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+43:12267:x1875953097719424:12345-192.168.202.16@tcp:101:dd.0 Request processed in 4753us (4989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048633.761651:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 168 00000100:00100000:1.0:1789048633.768797:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048633.768866:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097719680 00000100:00100000:0.0:1789048633.768881:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097719680 00000100:00100000:0.0:1789048633.769079:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 169 00000100:00100000:0.0:1789048633.769093:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+43:12267:x1875953097719680:12345-192.168.202.16@tcp:36:dd.0 00010000:00010000:0.0:1789048633.769474:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877696f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.769498:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877696f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.769513:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877696f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789048633.769584:0:8649:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967447 00000004:00010000:0.0:1789048633.769613:0:8649:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000007d87fb2e reply state 00000000cb27a86b transno 4294967448 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877696f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.769629:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877696f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048633.769638:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:0.0:1789048633.769642:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789048633.769648:0:8649:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789048633.769796:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+46:12267:x1875953097719680:12345-192.168.202.16@tcp:36:dd.0 Request processed in 706us (1013us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1789048633.769805:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 169 00000020:00080000:0.0:1789048633.769812:0:8649:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789048633.822425:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789048633.822446:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111417344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048633.822448:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08a05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111417216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048633.823479:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111417472:0@lo:400:kworker.0 00000100:00100000:1.0:1789048633.823581:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111417728:0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.830396:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048633.830706:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111417856:0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.830770:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048633.830793:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111418368:0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.830822:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048633.830884:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111418880:0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.830907:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048633.830970:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111418368 00000100:00100000:3.0:1789048633.830982:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111418368 00000100:00100000:3.0:1789048633.831044:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111418880 00000100:00100000:3.0:1789048633.831047:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111418880 00000100:00100000:3.0:1789048633.831081:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789048633.832017:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111418368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.832127:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111418368:12345-0@lo:400:kworker.0 Request processed in 127us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048633.832135:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789048633.832165:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789048633.832174:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06970700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111418880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.834541:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06970700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111418880:12345-0@lo:400:kworker.0 Request processed in 2354us (3618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048633.834559:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:3.0:1789048633.834626:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789048633.834633:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789048633.834696:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111418368:0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.834711:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111418880:0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.834837:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111417856 00000100:00100000:3.0:1789048633.834846:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111417856 00000100:00100000:3.0:1789048633.834915:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1789048633.834934:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111417856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.834995:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111417856:12345-0@lo:400:kworker.0 Request processed in 71us (4224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048633.835002:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1789048633.835030:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111417856:0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.835072:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048633.835252:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048633.835292:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111417472 00000100:00100000:2.0:1789048633.835297:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111417472 00000100:00100000:2.0:1789048633.835329:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1789048633.835351:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3623:x1875953111417472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048633.835384:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3623:x1875953111417472:12345-0@lo:400:kworker.0 Request processed in 35us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048633.835391:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1789048633.835444:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111417472:0@lo:400:kworker.0 00000100:00100000:2.0:1789048633.835458:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111417984:0@lo:400:kworker.0 00000100:00100000:2.0:1789048633.835495:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048633.835519:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111417984 00000100:00100000:2.0:1789048633.835523:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111417984 00000100:00100000:2.0:1789048633.835548:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789048633.835554:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111417984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048633.835584:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111417984:12345-0@lo:400:kworker.0 Request processed in 30us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048633.835590:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789048633.835612:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111417984:0@lo:400:kworker.0 00000100:00100000:2.0:1789048633.835619:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111418496:0@lo:400:kworker.0 00000100:00100000:2.0:1789048633.835644:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048633.835697:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111417600:0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.835731:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048633.835745:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048633.835757:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111418112:0@lo:400:kworker.0 00000100:00100000:1.0:1789048633.835778:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111418240:0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.835813:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048633.835837:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111417728 00000100:00100000:1.0:1789048633.835853:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111417728 00000100:00100000:1.0:1789048633.835895:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789048633.835902:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111417728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.835915:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111418624:0@lo:400:kworker.0 00000100:00100000:0.0:1789048633.835925:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111417344 00000100:00100000:0.0:1789048633.835939:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111417344 00000100:00100000:1.0:1789048633.835944:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111417728:12345-0@lo:400:kworker.0 Request processed in 41us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048633.835951:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789048633.835977:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111418496 00000100:00100000:1.0:1789048633.835981:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111418496 00000100:00100000:0.0:1789048633.835989:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111417216 00000100:00100000:0.0:1789048633.835995:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111417216 00000100:00100000:3.0:1789048633.836021:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048633.836027:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789048633.836040:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789048633.836042:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d310e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111417344:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048633.836055:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111418496:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1789048633.836066:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048633.836069:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111417600 00000100:00100000:3.0:1789048633.836076:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111417600 00000100:00100000:1.0:1789048633.836100:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111418496:12345-0@lo:400:kworker.0 Request processed in 49us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048633.836108:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789048633.836111:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111418112 00000100:00100000:3.0:1789048633.836116:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111418112 00000100:00100000:0.0:1789048633.836129:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d310e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111417344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (5746us total) trans 0 rc 0/0 00000100:00080000:1.0:1789048633.836131:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789048633.836140:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789048633.836140:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789048633.836143:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111418624 00000100:00100000:3.0:1789048633.836148:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111418624 00000100:00100000:0.0:1789048633.836183:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789048633.836194:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875953111417216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789048633.836204:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048633.836237:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875953111417216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048633.836243:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789048633.836257:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1789048633.836270:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111417600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.836309:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111417600:12345-0@lo:400:kworker.0 Request processed in 43us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048633.836316:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1789048633.836330:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1789048633.836361:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111418112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.836392:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111418112:12345-0@lo:400:kworker.0 Request processed in 33us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048633.836398:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1789048633.836473:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1789048633.836480:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111418624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.836511:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111418624:12345-0@lo:400:kworker.0 Request processed in 32us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048633.836518:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789048633.836536:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111417344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048633.836553:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111417600:0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.836568:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111418112:0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.836592:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111418624:0@lo:400:kworker.0 00000100:00080000:0.0:1789048633.836598:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048633.836612:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08a05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111417216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048633.836673:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111418496:0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.836679:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111419008:0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.836717:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048633.836923:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048633.836945:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111418752:0@lo:400:kworker.0 00000100:00100000:1.0:1789048633.836971:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048633.836989:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111418240 00000100:00100000:3.0:1789048633.836996:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111418240 00000100:00100000:1.0:1789048633.837002:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111417728:0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.837036:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1789048633.837037:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111418752 00000100:00100000:1.0:1789048633.837042:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111418752 00000100:00100000:3.0:1789048633.837046:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111418240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048633.837077:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789048633.837085:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111418752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048633.837094:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111418240:12345-0@lo:400:kworker.0 Request processed in 51us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048633.837120:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111418752:12345-0@lo:400:kworker.0 Request processed in 35us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048633.837126:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00010000:00080000:1.0:1789048633.837151:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08109180 x1875953111418240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048633.837165:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00080000:3.0:1789048633.837184:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789048633.837487:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111419008 00000100:00100000:0.0:1789048633.837492:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111419008 00000100:00100000:0.0:1789048633.837578:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789048633.837588:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111419008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048633.837612:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111418240:0@lo:400:kworker.0 00010000:00080000:1.0:1789048633.837631:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08108e00 x1875953111418752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048633.837643:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111418752:0@lo:400:kworker.0 00000100:00100000:0.0:1789048633.837643:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111419008:12345-0@lo:400:kworker.0 Request processed in 55us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048633.837656:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789048633.837701:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111419008:0@lo:400:kworker.0 00000100:00100000:0.0:1789048634.042550:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048634.042858:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097719808 00000100:00100000:3.0:1789048634.042873:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097719808 00000100:00100000:3.0:1789048634.043076:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 170 00000100:00100000:3.0:1789048634.043093:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+46:12281:x1875953097719808:12345-192.168.202.16@tcp:101:stat.0 00010000:00010000:3.0:1789048634.043125:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048634.043152:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776976 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29947 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.043252:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877697d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.043271:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877697d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.043309:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877697d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.043323:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776984 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.043330:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776984 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.043384:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776984 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.043503:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877698b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.043517:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776953 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29939 expref: 47 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.043526:0:6499:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877698b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.043570:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776953 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29939 expref: 47 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.043588:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776953 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29939 expref: 47 pid: 12131 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048634.043605:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875953111419136:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048634.043812:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06976b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789048634.046992:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875953111419136:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048634.047042:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877698b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789048634.047147:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789048634.048095:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048634.048651:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097720064 00000100:00100000:2.0:1789048634.048669:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097720064 00000100:00100000:2.0:1789048634.048750:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:2.0:1789048634.048761:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+48:6166:x1875953097720064:12345-192.168.202.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789048634.049656:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+49:6166:x1875953097720064:12345-192.168.202.16@tcp:35:ldlm_bl.0 Request processed in 893us (1563us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789048634.049664:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:2.0:1789048634.051914:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048634.052083:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097720192 00000100:00100000:0.0:1789048634.052099:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097720192 00010000:00010000:0.0:1789048634.052167:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776953 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29939 expref: 49 pid: 12131 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048634.052218:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 84 00000100:00100000:0.0:1789048634.052231:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c07cf6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+49:2393:x1875953097720192:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048634.052252:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048634.052261:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776953 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29939 expref: 49 pid: 12131 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.052277:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776953 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29939 expref: 49 pid: 12131 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.052304:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776953 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29939 expref: 49 pid: 12131 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.052324:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:0.0:1789048634.052330:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877698b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.052404:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877698b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.052532:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877698b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.052585:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048634.052655:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c07cf6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+48:2393:x1875953097720192:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 426us (752us total) trans 0 rc 0/0 00010000:00010000:1.0:1789048634.053392:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877698b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.053405:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877698b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048634.053521:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 84 00000004:00200000:1.0:1789048634.053704:0:6499:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789048634.053709:0:6499:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789048634.053744:0:6499:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877698b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.053763:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877698b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.053775:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877697d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.053783:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877697d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.053791:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877697d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.053797:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048634.053813:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877697d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.053831:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877697d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.053847:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:1.0:1789048634.053851:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048634.053856:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877697d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.053863:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c0877697d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.053890:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776984 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.053897:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776984 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.053903:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776984 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.053910:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048634.053913:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776984 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.053919:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776984 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.053928:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959c02b11400) 00010000:00010000:1.0:1789048634.053931:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048634.053941:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776984 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.053947:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776984 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.053995:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776976 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29947 expref: 48 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.054011:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877698b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29947 expref: 47 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.054019:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:1.0:1789048634.054021:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789048634.054023:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3de00, rc 0) 00000100:00100000:1.0:1789048634.054083:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+47:12281:x1875953097719808:12345-192.168.202.16@tcp:101:stat.0 Request processed in 10996us (11552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048634.054090:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 170 00000100:00100000:2.0:1789048634.139428:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048634.139982:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097720448 00000100:00100000:1.0:1789048634.139997:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097720448 00000100:00100000:1.0:1789048634.140627:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 171 00000100:00100000:1.0:1789048634.140643:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+47:12287:x1875953097720448:12345-192.168.202.16@tcp:36:truncate.0 00010000:00010000:1.0:1789048634.140735:0:12131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048634.140774:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877698b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29947 expref: 47 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.140801:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:1.0:1789048634.140807:0:12131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789048634.141308:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776992 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.141607:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776992 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.141626:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776992 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789048634.141754:0:12131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1789048634.141788:0:12131:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000001074f27b reply state 000000007e025c93 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776992 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.141803:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776992 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.141809:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:1.0:1789048634.141812:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789048634.141816:0:12131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789048634.142195:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+49:12287:x1875953097720448:12345-192.168.202.16@tcp:36:truncate.0 Request processed in 1553us (2787us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1789048634.142206:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 171 00000020:00080000:1.0:1789048634.142213:0:12131:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789048634.318618:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048634.319213:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097720576 00000100:00100000:3.0:1789048634.319231:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097720576 00000100:00100000:3.0:1789048634.319323:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 172 00000100:00100000:3.0:1789048634.319454:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+49:12301:x1875953097720576:12345-192.168.202.16@tcp:101:stat.0 00010000:00010000:2.0:1789048634.319935:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048634.320239:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776999 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2994e expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.320375:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769a0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.320394:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.320410:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.320423:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c087769a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.320431:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c087769a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.320438:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c087769a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.320559:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c087769ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.320570:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c087769ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.320577:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c087769ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048634.320631:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789048634.320637:0:6498:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789048634.320666:0:6498:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c087769ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.320755:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c087769ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.320767:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.320775:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769a0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.320784:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.320792:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048634.320798:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.320808:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769a0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.321014:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:2.0:1789048634.321017:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048634.321026:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.321403:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.321425:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c087769a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.321433:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c087769a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.321440:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c087769a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.321445:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048634.321449:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c087769a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.321456:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c087769a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.321465:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959c02b11400) 00010000:00010000:2.0:1789048634.321467:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048634.321471:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c087769a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.321477:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c087769a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.321535:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776999 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2994e expref: 51 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.321553:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c087769ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2994e expref: 50 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.321561:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:2.0:1789048634.321563:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789048634.321566:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb0a00, rc 0) 00000100:00100000:2.0:1789048634.321840:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+50:12301:x1875953097720576:12345-192.168.202.16@tcp:101:stat.0 Request processed in 2505us (3238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048634.321852:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 172 00010000:00010000:2.0:1789048634.334771:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048634.334847:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789048634.334888:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111419264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048634.334999:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048634.335174:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111419264 00000100:00100000:2.0:1789048634.335186:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111419264 00000100:00100000:2.0:1789048634.335263:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789048634.335275:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111419264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789048634.335323:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789048634.335421:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111419264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048634.335429:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789048634.336296:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111419264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048634.442451:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048634.442534:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097720832 00000100:00100000:1.0:1789048634.442546:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097720832 00000100:00100000:1.0:1789048634.442613:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 173 00000100:00100000:1.0:1789048634.442623:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+50:12311:x1875953097720832:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789048634.442648:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048634.442694:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087769b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29955 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048634.442842:0:6499:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789048634.443140:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087769b5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29955 expref: 52 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.443157:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfc600) 00010000:00010000:1.0:1789048634.443161:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789048634.443167:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087769b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29955 expref: 52 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.443186:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0000, rc 0) 00000100:00100000:1.0:1789048634.443459:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+51:12311:x1875953097720832:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 836us (1022us total) trans 4294967452 rc 301/301 00000100:00100000:1.0:1789048634.443468:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 173 00000100:00100000:0.0:1789048634.449609:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048634.450029:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097721088 00000100:00100000:3.0:1789048634.450043:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097721088 00000100:00100000:3.0:1789048634.450123:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:3.0:1789048634.450135:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b2aac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+51:12311:x1875953097721088:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1789048634.450482:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b2aac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+52:12311:x1875953097721088:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 349us (897us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1789048634.450490:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:2.0:1789048634.523289:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048634.523493:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097721344 00000100:00100000:1.0:1789048634.523506:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097721344 00000100:00100000:1.0:1789048634.523604:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 174 00000100:00100000:1.0:1789048634.523617:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+52:12317:x1875953097721344:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1789048634.523655:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048634.523685:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087769c3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2995c expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.523843:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087769ca lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.523861:0:12131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c087769ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2994e expref: 53 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.523902:0:12131:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087769ca lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.523952:0:12131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c087769ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2994e expref: 53 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.523968:0:12131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c087769ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2994e expref: 53 pid: 6498 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048634.523986:0:12131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12131:1875953111419392:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789048634.524225:0:12131:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b080bc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048634.527826:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048634.528146:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097721472 00000100:00100000:0.0:1789048634.528167:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097721472 00010000:00010000:0.0:1789048634.528231:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c087769ae lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2994e expref: 54 pid: 6498 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048634.528285:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 85 00000100:00100000:0.0:1789048634.528297:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+54:2394:x1875953097721472:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048634.528317:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048634.528325:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c087769ae lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2994e expref: 54 pid: 6498 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.528376:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c087769ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2994e expref: 54 pid: 6498 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.528405:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:0.0:1789048634.528413:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087769ca lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.528427:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087769ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.528437:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087769ca lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.528462:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048634.528538:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+54:2394:x1875953097721472:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 242us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048634.528568:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 85 00010000:00010000:2.0:1789048634.529136:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c087769ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2994e expref: 53 pid: 6498 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048634.529182:0:12131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12131:1875953111419392:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789048634.529209:0:12131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087769ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.529219:0:12131:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087769ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.529227:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087769ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048634.529254:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1789048634.529484:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087769c3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2995c expref: 54 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.529499:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087769ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2995c expref: 53 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.529506:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:2.0:1789048634.529508:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789048634.529511:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1200, rc 0) 00000100:00100000:2.0:1789048634.529683:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+53:12317:x1875953097721344:12345-192.168.202.16@tcp:101:bash.0 Request processed in 6068us (6409us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789048634.529689:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 174 00000100:00100000:3.0:1789048634.533461:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048634.533587:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097721728 00000100:00100000:2.0:1789048634.533601:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097721728 00000100:00100000:2.0:1789048634.533679:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 175 00000100:00100000:2.0:1789048634.533691:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+53:12317:x1875953097721728:12345-192.168.202.16@tcp:36:bash.0 00010000:00010000:2.0:1789048634.534070:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.534095:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.534110:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789048634.534165:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967455 00000004:00010000:2.0:1789048634.534193:0:6498:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000007e39f61f reply state 00000000a1aed368 transno 4294967456 ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.534208:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.534217:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:2.0:1789048634.534220:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789048634.534226:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789048634.534380:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+56:12317:x1875953097721728:12345-192.168.202.16@tcp:36:bash.0 Request processed in 691us (934us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1789048634.534388:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 175 00000020:00080000:2.0:1789048634.534393:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789048634.546216:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048634.546376:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097721856 00000100:00100000:1.0:1789048634.546389:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097721856 00000100:00100000:1.0:1789048634.546471:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 176 00000100:00100000:1.0:1789048634.546485:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+56:12317:x1875953097721856:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1789048634.546684:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048634.546719:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c087769df lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29963 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.546873:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087769e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.546893:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087769ca lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2995c expref: 57 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.546904:0:6499:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087769e6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.546972:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087769ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2995c expref: 57 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.546990:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087769ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2995c expref: 57 pid: 12131 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048634.547008:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3edcdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875953111419520:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789048634.547133:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b080bce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789048634.550886:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048634.551001:0:13167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097721984 00000100:00100000:2.0:1789048634.551014:0:13167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097721984 00010000:00010000:2.0:1789048634.551098:0:13167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087769ca lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2995c expref: 58 pid: 12131 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048634.551152:0:13167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 86 00000100:00100000:2.0:1789048634.551164:0:13167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d310380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+58:2393:x1875953097721984:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048634.551216:0:13167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048634.551226:0:13167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087769ca lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2995c expref: 58 pid: 12131 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.551244:0:13167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087769ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2995c expref: 58 pid: 12131 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.551273:0:13167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:2.0:1789048634.551280:0:13167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087769e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.551292:0:13167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087769e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.551305:0:13167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087769e6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.551380:0:13167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048634.551454:0:13167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d310380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+58:2393:x1875953097721984:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 292us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048634.551462:0:13167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 86 00010000:00010000:1.0:1789048634.552446:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c087769ca lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2995c expref: 57 pid: 12131 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048634.552473:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3edcdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875953111419520:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789048634.552500:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087769e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.552512:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087769e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.552518:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087769e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048634.552601:0:6499:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789048634.552607:0:6499:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789048634.552636:0:6499:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087769e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.552679:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c087769df lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29963 expref: 57 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.552721:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087769e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29963 expref: 56 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.552730:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:1.0:1789048634.552734:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789048634.552738:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0000, rc 0) 00000100:00100000:1.0:1789048634.552813:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+56:12317:x1875953097721856:12345-192.168.202.16@tcp:101:bash.0 Request processed in 6330us (6614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048634.552831:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 176 00000100:00100000:0.0:1789048634.556862:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048634.556986:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097722240 00000100:00100000:3.0:1789048634.557003:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097722240 00000100:00100000:3.0:1789048634.557095:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:3.0:1789048634.557109:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+56:12317:x1875953097722240:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:3.0:1789048634.557474:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+57:12317:x1875953097722240:12345-192.168.202.16@tcp:35:bash.0 Request processed in 367us (626us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1789048634.557483:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:3.0:1789048634.650098:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048634.650299:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097722496 00000100:00100000:2.0:1789048634.650312:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097722496 00000100:00100000:2.0:1789048634.650434:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 177 00000100:00100000:2.0:1789048634.650446:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+57:12327:x1875953097722496:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048634.650480:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048634.650510:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c087769ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2996a expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048634.650677:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789048634.650833:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c087769ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2996a expref: 59 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.650852:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfc600) 00010000:00010000:2.0:1789048634.650856:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789048634.650861:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c087769ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2996a expref: 59 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.650880:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb0a00, rc 0) 00000100:00100000:2.0:1789048634.650973:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+58:12327:x1875953097722496:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 528us (891us total) trans 4294967458 rc 301/301 00000100:00100000:2.0:1789048634.650984:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 177 00000100:00100000:0.0:1789048634.655486:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048634.655640:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097722624 00000100:00100000:3.0:1789048634.655655:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097722624 00000100:00100000:3.0:1789048634.655733:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 178 00000100:00100000:3.0:1789048634.655745:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+58:12327:x1875953097722624:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:3.0:1789048634.655858:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087769fb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.655891:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087769fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.655906:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087769fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.655921:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776a02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.655929:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776a02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.655936:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776a02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656031:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776a09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656042:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776a09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656048:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776a09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789048634.656136:0:6497:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776a09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656151:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087769fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656159:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087769fb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656166:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087769fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656173:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048634.656177:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087769fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656185:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087769fb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656199:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:3.0:1789048634.656202:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048634.656209:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087769fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656215:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c087769fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656231:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776a02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656237:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776a02 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656249:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776a02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656255:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3de00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048634.656257:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776a02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656264:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776a02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656272:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959c02b11400) 00010000:00010000:3.0:1789048634.656274:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048634.656277:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776a02 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656283:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776a02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656293:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776a09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656299:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776a09 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656304:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776a09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656309:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048634.656312:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776a09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656328:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776a09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656369:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:3.0:1789048634.656371:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048634.656375:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776a09 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.656381:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776a09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048634.656480:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+58:12327:x1875953097722624:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 736us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048634.656489:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 178 00000100:00100000:1.0:1789048634.659474:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048634.659710:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097722880 00000100:00100000:3.0:1789048634.659724:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097722880 00000100:00100000:3.0:1789048634.659799:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:3.0:1789048634.659811:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+58:12327:x1875953097722880:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1789048634.660172:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+59:12327:x1875953097722880:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 361us (711us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1789048634.660181:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:1.0:1789048634.697873:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048634.698213:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097723136 00000100:00100000:3.0:1789048634.698229:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097723136 00000100:00100000:3.0:1789048634.698314:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 179 00000100:00100000:3.0:1789048634.698327:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+59:12330:x1875953097723136:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789048634.700543:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048634.700589:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776a10 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29971 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.701225:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776a17 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.701251:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776a17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.701268:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776a17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.701282:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776a1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.701289:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776a1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.701295:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776a1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.701495:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776a25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.701506:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776a25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.701541:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776a25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048634.701812:0:6499:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789048634.702009:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776a17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.702018:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776a17 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.702026:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776a17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.702032:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048634.702236:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776a17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.702247:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776a17 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.702265:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:0.0:1789048634.702269:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048634.702275:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776a17 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.702283:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776a17 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.702303:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776a1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.702308:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776a1e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.702328:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776a1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.702489:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048634.702493:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776a1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.702499:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776a1e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.702508:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959c02b11400) 00010000:00010000:0.0:1789048634.702511:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048634.702514:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776a1e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.702519:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776a1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.702580:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776a10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29971 expref: 62 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.702598:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776a25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29971 expref: 61 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048634.702605:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:0.0:1789048634.702608:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048634.702610:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39000, rc 0) 00000100:00100000:0.0:1789048634.702738:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+61:12330:x1875953097723136:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 4412us (4889us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1789048634.702759:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 179 00000100:00100000:0.0:1789048634.707980:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048634.708185:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048634.708368:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097723392 00000100:00100000:3.0:1789048634.708383:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097723392 00000100:00100000:3.0:1789048634.708494:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:3.0:1789048634.708507:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+61:2393:x1875953097723392:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048634.708529:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048634.708561:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776a25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29971 expref: 61 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048634.708587:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:3.0:1789048634.708593:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048634.708676:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+60:2393:x1875953097723392:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 163us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048634.708684:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:2.0:1789048634.710218:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097723264 00000100:00100000:2.0:1789048634.710234:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097723264 00000100:00100000:2.0:1789048634.710448:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 180 00000100:00100000:2.0:1789048634.710462:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+60:12330:x1875953097723264:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:2.0:1789048634.710561:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776a33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.710582:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776a33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.710598:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776a33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.710648:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776a33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.710688:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776a33 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.710696:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776a33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.710703:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048634.710708:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776a33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.710716:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776a33 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.710730:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:2.0:1789048634.710734:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789048634.710740:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776a33 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.710747:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776a33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048634.711075:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+60:12330:x1875953097723264:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 615us (3108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048634.711084:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 180 00000100:00100000:0.0:1789048634.713801:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048634.714003:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097723648 00000100:00100000:3.0:1789048634.714019:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097723648 00000100:00100000:3.0:1789048634.714101:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:3.0:1789048634.714113:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+60:12330:x1875953097723648:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1789048634.714475:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+61:12330:x1875953097723648:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 362us (689us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789048634.714483:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:0.0:1789048634.846681:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789048634.846713:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111419648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789048634.846840:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048634.847068:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111419648 00000100:00100000:3.0:1789048634.847078:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111419648 00000100:00100000:3.0:1789048634.847166:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789048634.847179:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111419648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789048634.847219:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789048634.847278:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111419648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048634.847285:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789048634.847317:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111419648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048634.847373:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111419776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048634.847405:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048634.847620:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111419776 00000100:00100000:2.0:1789048634.847626:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111419776 00000100:00100000:2.0:1789048634.847659:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789048634.847665:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111419776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789048634.847679:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789048634.847734:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111419776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048634.847741:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789048634.847835:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111419776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789048634.865232:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048634.865410:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097723904 00000100:00100000:1.0:1789048634.865425:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097723904 00000100:00100000:1.0:1789048634.865513:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 181 00000100:00100000:1.0:1789048634.865525:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+61:12348:x1875953097723904:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:1.0:1789048634.865560:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048634.865596:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776a3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29978 expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.865747:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776a41 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.865768:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776a41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.865808:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776a41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048634.865836:0:8649:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789048634.865985:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776a3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29978 expref: 64 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.866011:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776a41 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29978 expref: 63 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.866021:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:1.0:1789048634.866025:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789048634.866029:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0800, rc 0) 00000100:00100000:1.0:1789048634.866116:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+63:12348:x1875953097723904:12345-192.168.202.16@tcp:101:cat.0 Request processed in 592us (898us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1789048634.866124:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 181 00000100:00100000:0.0:1789048634.889439:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048634.890110:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097724032 00000100:00100000:1.0:1789048634.890127:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097724032 00000100:00100000:1.0:1789048634.890227:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 182 00000100:00100000:1.0:1789048634.890240:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+63:12349:x1875953097724032:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789048634.890274:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048634.890304:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776a4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2997f expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.890630:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776a56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.890667:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776a56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.890678:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776a56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048634.890749:0:6499:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789048634.890753:0:6499:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789048634.890778:0:6499:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776a56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.890823:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0c00/0x133f221c08776a4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2997f expref: 65 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.890852:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776a56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2997f expref: 64 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048634.890862:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:1.0:1789048634.890865:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789048634.890870:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1c00, rc 0) 00000100:00100000:1.0:1789048634.891266:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+64:12349:x1875953097724032:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1023us (1834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048634.891278:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 182 00000100:00100000:0.0:1789048634.902605:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048634.904290:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097724416 00000100:00100000:3.0:1789048634.904315:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097724416 00000100:00100000:3.0:1789048634.904491:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:3.0:1789048634.904505:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+64:12349:x1875953097724416:12345-192.168.202.16@tcp:35:lfs.0 00000001:00080000:3.0:1789048634.905002:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000100:00100000:3.0:1789048634.905217:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+66:12349:x1875953097724416:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 713us (2625us total) trans 4294967464 rc 0/0 00000100:00100000:3.0:1789048634.905227:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48 00000020:00080000:3.0:1789048634.905234:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789048634.908468:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048634.911895:0:13167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097724544 00000100:00100000:2.0:1789048634.911920:0:13167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097724544 00000100:00100000:2.0:1789048634.912035:0:13167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:2.0:1789048634.912050:0:13167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+66:12349:x1875953097724544:12345-192.168.202.16@tcp:103:lfs.0 00010000:00010000:2.0:1789048634.912073:0:13167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789048634.912106:0:13167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087769e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29963 expref: 66 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.912135:0:13167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c08776a41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29978 expref: 65 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.912160:0:13167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087768e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2991d expref: 64 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.912173:0:13167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:2.0:1789048634.912179:0:13167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048634.912264:0:13167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+63:12349:x1875953097724544:12345-192.168.202.16@tcp:103:lfs.0 Request processed in 217us (3810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048634.912273:0:13167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:0.0:1789048634.926734:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048634.926889:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097724672 00000100:00100000:2.0:1789048634.926905:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097724672 00000100:00100000:2.0:1789048634.927052:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 183 00000100:00100000:2.0:1789048634.927065:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+63:12349:x1875953097724672:12345-192.168.202.16@tcp:58:lfs.0 00010000:00010000:2.0:1789048634.927283:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776a5d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.927316:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776a5d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.927368:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776a5d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789048634.927966:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789048634.928295:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+63:12349:x1875953097724672:12345-192.168.202.16@tcp:58:lfs.0 Request processed in 1229us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048634.928307:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 183 00000100:00100000:0.0:1789048634.950417:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048634.950488:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097724800 00000100:00100000:2.0:1789048634.950502:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097724800 00000100:00100000:2.0:1789048634.950639:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 184 00000100:00100000:2.0:1789048634.950652:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+63:12351:x1875953097724800:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048634.950681:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048634.950710:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776a64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29986 expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.950823:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c08776a6b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.950843:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c08776a6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.950860:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c08776a6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.950875:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776a72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.950905:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.950913:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.951010:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c08776a79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.951020:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c08776a79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.951027:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c08776a79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048634.951097:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789048634.951103:0:12131:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789048634.951133:0:12131:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c08776a79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.951154:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c08776a79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.951164:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c08776a6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.951171:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c08776a6b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.951178:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c08776a6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.951195:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048634.951201:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c08776a6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.951209:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c08776a6b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.951224:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:2.0:1789048634.951227:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048634.951233:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c08776a6b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.951241:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c08776a6b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.951257:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.951263:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776a72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.951269:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776a72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.951274:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048634.951277:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776a72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.951284:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776a72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.951303:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959c02b11400) 00010000:00010000:2.0:1789048634.951305:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048634.951309:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776a72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.951315:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776a72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.951412:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776a64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29986 expref: 65 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.951427:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c08776a79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29986 expref: 64 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048634.951435:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:2.0:1789048634.951437:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789048634.951440:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb0000, rc 0) 00000100:00100000:2.0:1789048634.951530:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+64:12351:x1875953097724800:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 880us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048634.951539:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 184 00010000:00010000:3.0:1789048635.358525:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789048635.555626:0:13779:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789048635.555636:0:13779:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789048635.555748:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789048635.555756:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789048635.556223:0:13779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20221f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13779:1875953111419904:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789048635.556413:0:13779:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b98840 going to sleep for 11 seconds 00000100:00100000:3.0:1789048635.564883:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048635.565008:0:13779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20221f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13779:1875953111419904:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789048635.570266:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097724928 00000100:00100000:1.0:1789048635.570284:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097724928 00000100:00100000:1.0:1789048635.570481:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 185 00000100:00100000:1.0:1789048635.570493:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+64:12363:x1875953097724928:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789048635.570533:0:6499:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789048635.570707:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+64:12363:x1875953097724928:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 216us (5833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048635.570714:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 185 00000100:00100000:1.0:1789048635.580841:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048635.581370:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097725056 00000100:00100000:3.0:1789048635.581379:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097725056 00000100:00100000:3.0:1789048635.581504:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 186 00000100:00100000:3.0:1789048635.581515:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+64:12363:x1875953097725056:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789048635.581781:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776a80 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.581798:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776a80 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.581820:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776a80 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.582278:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776a87 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.582300:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776a87 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.582307:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776a87 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.582532:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776a8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.582793:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776a8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.582803:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776a8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048635.583265:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789048635.583271:0:6498:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789048635.583286:0:6498:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776a8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.583301:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776a80 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.583308:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776a80 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.583316:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776a80 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.583322:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3de00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048635.583326:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776a80 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.583386:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776a80 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.583400:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff959c05322a00) 00010000:00010000:3.0:1789048635.583403:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048635.583409:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776a80 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.583414:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776a80 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.583650:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776a87 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.583658:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776a87 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.583968:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776a87 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.583975:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048635.583978:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776a87 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.583985:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776a87 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.583996:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff959b06bfc200) 00010000:00010000:3.0:1789048635.583999:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048635.584002:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776a87 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.584019:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776a87 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.584036:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776a8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.584044:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776a8e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.584050:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776a8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.584055:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048635.584058:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776a8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.584064:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776a8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.584071:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:3.0:1789048635.584073:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048635.584076:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776a8e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.584082:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776a8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048635.584766:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+64:12363:x1875953097725056:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 Request processed in 3248us (3928us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048635.584777:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 186 00000100:00100000:1.0:1789048635.605924:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048635.605974:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097725312 00000100:00100000:1.0:1789048635.605984:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097725312 00000100:00100000:1.0:1789048635.606037:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 187 00000100:00100000:1.0:1789048635.606047:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+64:12363:x1875953097725312:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789048635.606070:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048635.606091:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776a95 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2998d expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.606204:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776a9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.606219:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776a9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.606231:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776a9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048635.606242:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789048635.606317:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776a9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.606325:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776a9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.606363:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776a9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.606368:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048635.606372:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776a9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.606381:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776a9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.606393:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:1.0:1789048635.606396:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789048635.606400:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776a9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.606406:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776a9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.606459:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776a95 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2998d expref: 66 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.606469:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff959c05322a00) 00010000:00010000:1.0:1789048635.606471:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789048635.606475:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776a95 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2998d expref: 66 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.606483:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0a00, rc 0) 00000100:00100000:1.0:1789048635.607168:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+65:12363:x1875953097725312:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 497us (628us total) trans 4294967465 rc 301/301 00000100:00100000:1.0:1789048635.607191:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 187 00000100:00100000:2.0:1789048635.621869:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048635.622062:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097725440 00000100:00100000:3.0:1789048635.622072:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097725440 00000100:00100000:3.0:1789048635.622143:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 188 00000100:00100000:3.0:1789048635.622156:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+65:12363:x1875953097725440:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789048635.622195:0:6499:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789048635.622312:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+65:12363:x1875953097725440:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 158us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048635.622319:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 188 00000100:00100000:1.0:1789048635.643585:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048635.643872:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097725696 00000100:00100000:3.0:1789048635.643882:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097725696 00000100:00100000:3.0:1789048635.644045:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 189 00000100:00100000:3.0:1789048635.644056:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+65:12363:x1875953097725696:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789048635.644079:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048635.644082:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789048635.644110:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776a56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2997f expref: 65 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.644126:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:3.0:1789048635.644130:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789048635.644303:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776aaa lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29994 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789048635.646023:0:6498:0:(osp_object.c:1667:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789048635.646800:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776ab1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.646830:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.646848:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.647290:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776aaa lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29994 expref: 67 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.647312:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29994 expref: 66 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.647321:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff959b06bfc200) 00010000:00010000:3.0:1789048635.647324:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789048635.647328:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3c000, rc 0) 00000100:00100000:3.0:1789048635.647536:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+66:12363:x1875953097725696:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 3479us (3961us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1789048635.647555:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 189 00000100:00100000:2.0:1789048635.672279:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000040:00080000:3.0:1789048635.672675:0:14586:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789048635.672680:0:14586:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789048635.672715:0:14586:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1789048635.672722:0:14586:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789048635.677277:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097725952 00000100:00100000:1.0:1789048635.677291:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097725952 00000100:00100000:1.0:1789048635.677385:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 190 00000100:00100000:1.0:1789048635.677396:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+66:12363:x1875953097725952:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789048635.677472:0:8649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048635.677503:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776ab1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29994 expref: 66 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.677523:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff959b06bfc200) 00010000:00010000:1.0:1789048635.677535:0:8649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789048635.677571:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776abf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.677587:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776abf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.677597:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776abf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.677652:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776ac6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xbad41655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.677660:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776ac6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbad41655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.678017:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776ac6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbad41655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.678080:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776abf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.678088:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776abf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.678094:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776abf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.678100:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048635.678104:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776abf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.678111:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776abf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.678119:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:1.0:1789048635.678122:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048635.678125:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776abf lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.678130:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776abf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.678139:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776ac6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbad41655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.678145:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776ac6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbad41655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.678150:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776ac6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbad41655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.678161:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048635.678164:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776ac6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbad41655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.678170:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776ac6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbad41655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.678178:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xbad41655 (ffff959c3ef4a600) 00010000:00010000:1.0:1789048635.678180:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048635.678183:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776ac6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xbad41655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.678188:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776ac6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xbad41655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048635.678284:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+65:12363:x1875953097725952:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 889us (6016us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789048635.678294:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 190 00000100:00100000:0.0:1789048635.685847:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048635.685989:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097726080 00000100:00100000:1.0:1789048635.686001:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097726080 00000100:00100000:1.0:1789048635.686061:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 191 00000100:00100000:1.0:1789048635.686072:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+65:12363:x1875953097726080:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789048635.686093:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048635.686115:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776acd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b2999b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.686151:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776ad4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.686178:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.686191:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.686298:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c08776acd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2999b expref: 67 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.686313:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2999b expref: 66 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.686321:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff959c3ef4a600) 00010000:00010000:1.0:1789048635.686323:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789048635.686326:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0a00, rc 0) 00000100:00100000:1.0:1789048635.686409:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+66:12363:x1875953097726080:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 338us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048635.686416:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 191 00000100:00100000:0.0:1789048635.697851:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048635.698611:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097726336 00000100:00100000:3.0:1789048635.698621:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097726336 00000100:00100000:3.0:1789048635.698801:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 192 00000100:00100000:3.0:1789048635.698823:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+66:12363:x1875953097726336:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789048635.699016:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776adb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.699034:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776adb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.699056:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776adb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789048635.699212:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1789048635.699221:0:6498:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 390452886878ns, next at 391452884895ns, rc = 0 00000004:00010000:3.0:1789048635.699263:0:6498:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000007a0e33ee reply state 0000000040031b12 transno 4294967467 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776adb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.699275:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776adb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.699283:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff959c3ef4a600) 00010000:00010000:3.0:1789048635.699286:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789048635.699289:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789048635.699398:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+68:12363:x1875953097726336:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 577us (1556us total) trans 4294967467 rc 0/0 00000100:00100000:3.0:1789048635.699405:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 192 00000100:00100000:0.0:1789048635.710138:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048635.710299:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097726464 00000100:00100000:3.0:1789048635.710309:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097726464 00000100:00100000:3.0:1789048635.710410:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 193 00000100:00100000:3.0:1789048635.710431:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+68:12363:x1875953097726464:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789048635.710456:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048635.710479:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776ae2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b299a2 expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.710536:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776ae2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299a2 expref: 69 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.710844:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776ae2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299a2 expref: 69 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.710967:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff959c3ef4a600) 00010000:00010000:2.0:1789048635.710971:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789048635.710975:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3de00, rc 0) 00000100:00100000:2.0:1789048635.711035:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+69:12363:x1875953097726464:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 616us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048635.711042:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 193 00000100:00100000:0.0:1789048635.718053:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048635.720895:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097726592 00000100:00100000:3.0:1789048635.721585:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097726592 00000100:00100000:1.0:1789048635.721779:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:1.0:1789048635.721790:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2393:x1875953097726592:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789048635.721842:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789048635.722049:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2393:x1875953097726592:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 260us (4005us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789048635.722056:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:3.0:1789048635.730851:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048635.731550:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097726848 00000100:00100000:1.0:1789048635.731561:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097726848 00000100:00100000:1.0:1789048635.731621:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:1.0:1789048635.731638:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+69:12363:x1875953097726848:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789048635.732054:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+70:12363:x1875953097726848:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 417us (1210us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1789048635.732062:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:3.0:1789048635.734034:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048635.734276:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097727104 00000100:00100000:2.0:1789048635.734284:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097727104 00000100:00100000:2.0:1789048635.734362:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 194 00000100:00100000:2.0:1789048635.734373:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+70:12363:x1875953097727104:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789048635.734478:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+70:12363:x1875953097727104:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 107us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048635.734486:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 194 00000100:00100000:0.0:1789048635.749130:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048635.749209:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097727232 00000100:00100000:3.0:1789048635.749220:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097727232 00000100:00100000:3.0:1789048635.749311:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 195 00000100:00100000:3.0:1789048635.749322:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+70:12363:x1875953097727232:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789048635.749359:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048635.749381:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776ae9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b299a9 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.749455:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776af0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.749468:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776af0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.749480:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776af0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048635.749525:0:6498:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789048635.749553:0:6498:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776af0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.749594:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776ae9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299a9 expref: 72 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.749610:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776af0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299a9 expref: 71 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.749619:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff959c3ef4a600) 00010000:00010000:3.0:1789048635.749621:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789048635.749625:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3ca00, rc 0) 00000100:00100000:3.0:1789048635.749705:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+71:12363:x1875953097727232:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 384us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048635.749713:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 195 00000100:00100000:3.0:1789048635.757761:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048635.758544:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097727360 00000100:00100000:0.0:1789048635.758554:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097727360 00000100:00100000:0.0:1789048635.758603:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:0.0:1789048635.758612:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2393:x1875953097727360:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789048635.758630:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048635.758649:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08776af7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b299b0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789048635.758782:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fa4185184f40, blocks: 0x0 00010000:00010000:0.0:1789048635.758801:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1789048635.758814:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048635.758824:0:8412:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08776af7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299b0 expref: 8 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.758840:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08776af7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299b0 expref: 8 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.758852:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39600, rc 0) 00000100:00100000:0.0:1789048635.758911:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2393:x1875953097727360:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 299us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048635.758917:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:2.0:1789048635.765948:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048635.766088:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097727616 00000100:00100000:3.0:1789048635.766097:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097727616 00000100:00100000:3.0:1789048635.766152:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 196 00000100:00100000:3.0:1789048635.766162:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08204380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+71:12363:x1875953097727616:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789048635.766256:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08204380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+71:12363:x1875953097727616:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 95us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048635.766263:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 196 00000100:00100000:1.0:1789048635.773096:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048635.773135:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097727744 00000100:00100000:1.0:1789048635.773145:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097727744 00000100:00100000:1.0:1789048635.773197:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:1.0:1789048635.773207:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:12363:x1875953097727744:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789048635.773225:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048635.773244:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7c9eab8/0x133f221c08776afe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b299b7 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.773277:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08776af7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299b0 expref: 9 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.773286:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048635.773290:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048635.773294:0:8413:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c9eab8/0x133f221c08776afe lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299b7 expref: 9 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.773329:0:8413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08776af7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299b0 expref: 9 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.773358:0:8413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08776af7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299b0 expref: 9 pid: 8412 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048635.773387:0:8413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1875953111420032:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789048635.773478:0:8413:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b080bcb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789048635.779633:0:8413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1875953111420032:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789048635.779750:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c7c9eab8/0x133f221c08776afe lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b299b7 expref: 9 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.779770:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0c00, rc 0) 00000100:00100000:1.0:1789048635.781658:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:12363:x1875953097727744:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 8442us (8560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048635.781681:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:2.0:1789048635.787760:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048635.787962:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097727872 00000100:00100000:2.0:1789048635.787972:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097727872 00010000:00010000:2.0:1789048635.788012:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08776af7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299b0 expref: 9 pid: 8412 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048635.788052:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 87 00000100:00100000:2.0:1789048635.788062:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08207800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:2394:x1875953097727872:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048635.788077:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048635.788104:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08776af7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299b0 expref: 9 pid: 8412 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.788134:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08776af7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299b0 expref: 9 pid: 8412 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.788160:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08776af7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299b0 expref: 9 pid: 8412 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.788177:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048635.788182:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048635.788190:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7c9eab8/0x133f221c08776afe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b299b7 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.788201:0:6481:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c9eab8/0x133f221c08776afe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b299b7 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.788237:0:6481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c7c9eab8/0x133f221c08776afe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b299b7 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048635.788252:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6481:1875953111420160:192.168.202.16@tcp:105: 00000100:00100000:2.0:1789048635.788355:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0793a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048635.791844:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6481:1875953111420160:192.168.202.16@tcp:105: 00010000:00010000:3.0:1789048635.791872:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048635.791941:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08207800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2394:x1875953097727872:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3879us (4189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048635.791951:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 87 00000100:00100000:3.0:1789048635.793934:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048635.794067:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097728000 00000100:00100000:2.0:1789048635.794076:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097728000 00002000:00100000:2.0:1789048635.794126:0:8418:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff959b080a1c00 x1875953097728000/t0(0) o4->85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp:646/0 lens 504/0 e 0 to 0 dl 1789048646 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789048635.794139:0:8418:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b080a1c00 with x1875953097728000 ext(0->8) 00002000:00010000:2.0:1789048635.794151:0:8418:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff959b080a1c00 00000100:00100000:2.0:1789048635.794189:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:2.0:1789048635.794199:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2394:x1875953097728000:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789048635.795120:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+10:2394:x1875953097728000:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 Request processed in 918us (1190us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789048635.795131:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00002000:00100000:2.0:1789048635.795139:0:8418:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff959b080a1c00 x1875953097728000/t4294967315(0) o4->85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp:646/0 lens 504/448 e 0 to 0 dl 1789048646 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789048635.795149:0:8418:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b080a1c00 with x1875953097728000 ext(0->8) 00002000:00010000:2.0:1789048635.795153:0:8418:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff959b080a1c00 00000100:00100000:2.0:1789048635.805088:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048635.808612:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097728128 00000100:00100000:1.0:1789048635.808627:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097728128 00000100:00100000:0.0:1789048635.809226:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 197 00000100:00100000:0.0:1789048635.809237:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+71:12363:x1875953097728128:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789048635.811576:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967468 is committed 00000004:00080000:2.0:1789048635.811593:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1789048635.811654:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789048635.811668:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff959c32f3e780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789048635.811673:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff959c2b643e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff959c32f3ef00 00000020:00080000:2.0:1789048635.811676:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff959c2b643300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff959b05d42800 00000020:00080000:2.0:1789048635.811803:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1789048635.811875:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789048635.811893:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111420288:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789048635.811959:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789048635.811985:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c0877686c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.811998:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c0877686c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812007:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c0877686c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812014:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048635.812018:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c0877686c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812026:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c0877686c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812043:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959c02b11400) 00010000:00010000:3.0:1789048635.812046:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048635.812051:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c0877686c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812058:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c0877686c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812082:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877696f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812088:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877696f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812094:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877696f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812107:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048635.812110:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877696f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812116:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877696f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812126:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:3.0:1789048635.812128:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048635.812131:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877696f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812137:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c0877696f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812150:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776992 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812156:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776992 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812162:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776992 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812166:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048635.812169:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776992 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812175:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776992 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812193:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:3.0:1789048635.812196:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048635.812199:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776992 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812205:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776992 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812215:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812221:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812226:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812231:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048635.812233:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812239:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812245:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:3.0:1789048635.812247:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048635.812250:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769d8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812255:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c087769d8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812274:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776adb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812280:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776adb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812285:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776adb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812290:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048635.812293:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776adb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812299:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776adb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812306:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff959c3ef4a600) 00010000:00010000:3.0:1789048635.812308:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789048635.812311:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776adb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.812316:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776adb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048635.812400:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789048635.812409:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b082ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111420416:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789048635.812442:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048635.812496:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111420288 00000100:00100000:2.0:1789048635.812505:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111420288 00000100:00100000:2.0:1789048635.812561:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111420416 00000100:00100000:2.0:1789048635.812564:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111420416 00000100:00100000:2.0:1789048635.812595:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789048635.812603:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111420288:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789048635.812718:0:8804:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789048635.812721:0:8804:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789048636405936122 00002000:00010000:2.0:1789048635.812724:0:8804:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789048635.812725:0:8804:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789048636309000000 -> 1789048636405936122 00002000:00010000:2.0:1789048635.812727:0:8804:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789048635.812766:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111420288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 164us (808us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789048635.812772:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789048635.813096:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789048635.813104:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111420416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789048635.813119:0:8804:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:2.0:1789048635.813142:0:8804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x18d3fa40e01cfb95, atime: 0x18d3fa40ed1503b2, ctime: 0x18d3fa40e01cfb95, blocks: 0x8 00010000:00010000:2.0:1789048635.813149:0:8804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000195acb85/0x133f221c08776b05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.813164:0:8804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=390s v=(0 0) 00010000:00010000:2.0:1789048635.813168:0:8804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048635.813174:0:8804:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000195acb85/0x133f221c08776b05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.813584:0:8804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000195acb85/0x133f221c08776b05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.813595:0:8804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000195acb85/0x133f221c08776b05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.813609:0:8804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000195acb85/0x133f221c08776b05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.813626:0:8804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1789048635.813631:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789048635.813636:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048635.813739:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3621:x1875953111420416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 636us (1295us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789048635.813744:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:2.0:1789048635.813769:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048635.813774:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000195acb85/0x133f221c08776b05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.813782:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1800 already unused, calling callback (ffffffffc0c858f0) 00000004:00080000:3.0:1789048635.813801:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff959b082ee300/2, rc 0, transno 4294967308 00000100:00100000:3.0:1789048635.813825:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b082ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111420416:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789048635.814066:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000195acb85/0x133f221c08776b05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.814079:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000195acb85/0x133f221c08776b05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.814095:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000195acb85/0x133f221c08776b05 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.814103:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000195acb85/0x133f221c08776b05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.814122:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048635.814130:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048635.814132:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789048635.814242:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff959b0820ea00/2, rc 0, transno 4294967316 00000100:00100000:2.0:1789048635.814248:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111420288:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789048635.815609:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:12363:x1875953097728128:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 Request processed in 6368us (10525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048635.815620:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 197 00000100:00100000:3.0:1789048635.818848:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048635.819019:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097728256 00000100:00100000:1.0:1789048635.819030:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097728256 00000100:00100000:1.0:1789048635.819091:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:1.0:1789048635.819104:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b082ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+10:2392:x1875953097728256:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789048635.825450:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:0.0:1789048635.825464:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1789048635.834870:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b082ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2392:x1875953097728256:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 Request processed in 15759us (16021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048635.834883:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:3.0:1789048635.837532:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048635.837621:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097728512 00000100:00100000:0.0:1789048635.837631:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097728512 00000100:00100000:0.0:1789048635.837761:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 198 00000100:00100000:0.0:1789048635.837771:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:12363:x1875953097728512:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789048635.837831:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048635.837860:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776af0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299a9 expref: 20 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.837887:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff959c3ef4a600) 00010000:00010000:0.0:1789048635.837967:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789048635.837998:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776b0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.838012:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776b0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.838023:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776b0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789048635.838150:0:6498:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000005983b280 reply state 000000002b3ad63d transno 4294967469 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776b0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.838162:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776b0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.838169:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff959c3ef4a600) 00010000:00010000:0.0:1789048635.838171:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789048635.838174:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789048635.838275:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+21:12363:x1875953097728512:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 504us (752us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1789048635.838282:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 198 00000100:00100000:3.0:1789048635.840635:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048635.840675:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097728640 00000100:00100000:3.0:1789048635.840689:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097728640 00000100:00100000:3.0:1789048635.840738:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:3.0:1789048635.840748:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2393:x1875953097728640:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789048635.840999:0:8413:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789048635.841003:0:8413:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789048636405936122 -> 1789048635169000000 00002000:00010000:3.0:1789048635.841006:0:8413:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789048633758000000 00002000:00010000:3.0:1789048635.841008:0:8413:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789048636405936122 -> 1789048635169000000 00002000:00010000:3.0:1789048635.841010:0:8413:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789048635.841056:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2393:x1875953097728640:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 309us (434us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789048635.841063:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:3.0:1789048635.846737:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048635.846864:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097728896 00000100:00100000:1.0:1789048635.846875:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097728896 00000100:00100000:1.0:1789048635.847011:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 199 00000100:00100000:1.0:1789048635.847022:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+21:12363:x1875953097728896:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789048635.847097:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776b13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.847114:0:12131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776ad4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2999b expref: 21 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.847124:0:12131:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776b13 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.847156:0:12131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2999b expref: 21 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.847169:0:12131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2999b expref: 21 pid: 6497 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048635.847184:0:12131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12131:1875953111420544:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789048635.847316:0:12131:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b080bc180 going to sleep for 11 seconds 00000100:00100000:1.0:1789048635.854042:0:12131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12131:1875953111420544:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789048635.854070:0:12131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776b13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048635.855157:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048635.856530:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097729024 00000100:00100000:3.0:1789048635.856553:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097729024 00010000:00010000:3.0:1789048635.856598:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2999b expref: 22 pid: 6497 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048635.856655:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 88 00000100:00100000:3.0:1789048635.856958:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+22:2394:x1875953097729024:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048635.856975:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048635.856982:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2999b expref: 22 pid: 6497 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.856995:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2999b expref: 22 pid: 6497 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.857018:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08776ad4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b2999b expref: 22 pid: 6497 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.857032:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff959c3ef4a600) 00010000:00010000:3.0:1789048635.857038:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776b13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.857048:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776b13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.857057:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776b13 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.857086:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048635.857134:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+21:2394:x1875953097729024:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 181us (1982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048635.857141:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 88 00010000:00010000:1.0:1789048635.857293:0:12131:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776b13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.857302:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776b13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.857361:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776b13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.857378:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776b13 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.857384:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776b13 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.857389:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048635.857393:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776b13 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.857400:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776b13 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.857409:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff959c3ef4a600) 00010000:00010000:1.0:1789048635.857411:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789048635.857414:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776b13 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.858146:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c08776b13 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048635.858208:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:12363:x1875953097728896:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 Request processed in 11188us (11482us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789048635.858215:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 199 00000100:00100000:2.0:1789048635.864010:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048635.864091:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097729152 00000100:00100000:0.0:1789048635.864100:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097729152 00000100:00100000:0.0:1789048635.864190:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:0.0:1789048635.864201:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2391:x1875953097729152:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789048635.864269:0:8414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08776b1a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.864305:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7c9eab8/0x133f221c08776afe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b299b7 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.864313:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048635.864319:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789048635.864323:0:8414:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08776b1a lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.864381:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c7c9eab8/0x133f221c08776afe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0xd796648991b299b7 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.864394:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c7c9eab8/0x133f221c08776afe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b299b7 expref: 8 pid: 8413 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048635.864410:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08884380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1875953111420672:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789048635.864503:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3e000 going to sleep for 11 seconds 00000100:00100000:0.0:1789048635.870683:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111420800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048635.870752:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048635.870851:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111420800 00000100:00100000:1.0:1789048635.870858:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111420800 00000100:00100000:1.0:1789048635.870921:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789048635.870931:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111420800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789048635.870967:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789048635.871037:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111420800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048635.871044:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789048635.871397:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111420800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048635.871779:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048635.871858:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08884380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1875953111420672:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048635.871878:0:8414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08776b1a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048635.871993:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097729280 00000100:00100000:2.0:1789048635.871999:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097729280 00010000:00010000:2.0:1789048635.872030:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c9eab8/0x133f221c08776afe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b299b7 expref: 9 pid: 8413 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048635.872065:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 89 00000100:00100000:2.0:1789048635.872074:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c07cf6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:2394:x1875953097729280:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048635.872086:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048635.872105:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c7c9eab8/0x133f221c08776afe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b299b7 expref: 9 pid: 8413 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.872118:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c7c9eab8/0x133f221c08776afe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b299b7 expref: 9 pid: 8413 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.872140:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7c9eab8/0x133f221c08776afe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b299b7 expref: 9 pid: 8413 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.872153:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789048635.872157:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789048635.872162:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08776b1a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.872184:0:6482:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08776b1a lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.872212:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048635.872259:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c07cf6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2394:x1875953097729280:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 186us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048635.872266:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 89 00010000:00010000:0.0:1789048635.872669:0:8414:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08776b1a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.872686:0:8414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08776b1a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.872704:0:8414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08776b1a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.872713:0:8414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08776b1a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.872721:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08776b1a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.872728:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048635.872732:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08776b1a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.872740:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08776b1a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.872752:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08776b1a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.872760:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08776b1a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048635.872830:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2391:x1875953097729152:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 Request processed in 8631us (8945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048635.872839:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:2.0:1789048635.875497:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048635.875568:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097729536 00000100:00100000:3.0:1789048635.875604:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097729536 00000100:00100000:3.0:1789048635.875718:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 200 00000100:00100000:3.0:1789048635.875727:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:12363:x1875953097729536:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789048635.875868:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b21 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.875891:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776968 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29940 expref: 20 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.875901:0:6499:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b21 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.875958:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776968 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29940 expref: 20 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048635.875975:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776968 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29940 expref: 20 pid: 6498 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048635.875992:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08841880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875953111420928:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048635.876107:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2b0270c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048635.887578:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048635.890043:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097729664 00000100:00100000:0.0:1789048635.890062:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097729664 00010000:00010000:1.0:1789048635.890240:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776968 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29940 expref: 21 pid: 6498 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048635.890311:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 90 00000100:00100000:1.0:1789048635.890354:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+21:2393:x1875953097729664:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048635.890377:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048635.890386:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776968 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29940 expref: 21 pid: 6498 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.890401:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776968 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29940 expref: 21 pid: 6498 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.890430:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:1.0:1789048635.890437:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b21 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.890449:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.890458:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b21 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.890481:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048635.890575:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+21:2393:x1875953097729664:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 246us (3010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048635.890601:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 90 00010000:00010000:3.0:1789048635.892623:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776968 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29940 expref: 20 pid: 6498 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048635.892651:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08841880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875953111420928:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048635.892683:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.897219:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.897243:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.897869:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b28 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.897893:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776ae2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299a2 expref: 20 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.897903:0:6499:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b28 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.897967:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776ae2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299a2 expref: 20 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.897986:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776ae2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299a2 expref: 20 pid: 8649 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048635.898018:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875953111421056:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789048635.898323:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c14c03780 going to sleep for 11 seconds 00000100:00100000:1.0:1789048635.918361:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048635.918783:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097729792 00000100:00100000:0.0:1789048635.918795:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097729792 00010000:00010000:0.0:1789048635.918866:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776ae2 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299a2 expref: 21 pid: 8649 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048635.918915:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 91 00000100:00100000:0.0:1789048635.918927:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+21:2393:x1875953097729792:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048635.919193:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048635.919203:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776ae2 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299a2 expref: 21 pid: 8649 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.919220:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776ae2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299a2 expref: 21 pid: 8649 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.919247:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff959c3ef4a600) 00010000:00010000:0.0:1789048635.919254:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b28 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.919265:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.919275:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b28 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.919320:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048635.919424:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+21:2393:x1875953097729792:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 499us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048635.919432:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 91 00010000:00010000:2.0:1789048635.924104:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776ae2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299a2 expref: 20 pid: 8649 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048635.924141:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875953111421056:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789048635.924173:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.924185:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.924191:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789048635.924413:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00000001:00080000:0.0:1789048635.924671:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967471 00000001:00080000:0.0:1789048635.924717:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967472 00000100:00100000:0.0:1789048635.924833:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08884380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6499:1875953111421184:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789048635.924936:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048635.924990:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa6600 going to sleep for 11 seconds 00000100:00100000:2.0:1789048635.926664:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111421184 00000100:00100000:2.0:1789048635.926695:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111421184 00000100:00100000:2.0:1789048635.926796:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789048635.926817:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2acbb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6499:x1875953111421184:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789048635.926978:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2acbb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6499:x1875953111421184:12345-0@lo:1000:mdt00_002.0 Request processed in 172us (2042us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048635.926987:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789048635.927054:0:6499:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1789048635.927062:0:6499:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff959b0820ea00, transno 4294967316 00000100:00100000:0.0:1789048635.927101:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08884380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6499:1875953111421184:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789048635.927289:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000100:00100000:0.0:1789048635.927416:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08884380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6499:1875953111421312:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789048635.927596:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048635.927665:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c05346600 going to sleep for 11 seconds 00000100:00100000:1.0:1789048635.927728:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111421312 00000100:00100000:1.0:1789048635.927738:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111421312 00000100:00100000:1.0:1789048635.927813:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789048635.927825:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6499:x1875953111421312:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789048635.928016:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6499:x1875953111421312:12345-0@lo:1000:mdt00_002.0 Request processed in 193us (428us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789048635.928023:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789048635.928965:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08884380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6499:1875953111421312:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789048635.929036:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.929050:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b28 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.929060:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b28 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.929079:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048635.929213:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b28 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.929224:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b28 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.929245:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff959c3ef4a600) 00010000:00010000:0.0:1789048635.929249:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789048635.929255:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b28 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.929262:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b28 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.929295:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776a5d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.929303:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776a5d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.929309:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776a5d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.929315:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048635.929318:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776a5d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.929324:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776a5d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.929361:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:0.0:1789048635.929364:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789048635.929375:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776a5d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.929382:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0a00/0x133f221c08776a5d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.929420:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.929438:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c08776a79 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29986 expref: 23 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.929448:0:6499:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b2f lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.929496:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c08776a79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29986 expref: 23 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.929517:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c08776a79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29986 expref: 23 pid: 12131 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048635.929534:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08886a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875953111421440:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789048635.929981:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048635.949775:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048635.950231:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097729920 00000100:00100000:1.0:1789048635.950249:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097729920 00010000:00010000:1.0:1789048635.950309:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c08776a79 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29986 expref: 24 pid: 12131 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048635.950409:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 92 00000100:00100000:1.0:1789048635.950421:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+24:2393:x1875953097729920:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048635.950441:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048635.950450:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c08776a79 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29986 expref: 24 pid: 12131 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.950465:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c08776a79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29986 expref: 24 pid: 12131 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.950492:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:1.0:1789048635.950498:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.950532:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.951479:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b2f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.951515:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789048635.951766:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0000/0x133f221c08776a79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29986 expref: 24 pid: 12131 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048635.951788:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08886a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875953111421440:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048635.951826:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.951852:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048635.952269:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+23:2393:x1875953097729920:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1846us (2500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048635.952281:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 92 00010000:00010000:0.0:1789048635.952734:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.952752:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.952760:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b2f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.952767:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.952773:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048635.952779:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.952788:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b2f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.952802:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:0.0:1789048635.952815:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048635.952820:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b2f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.952826:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b2f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.952841:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.952869:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b21 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.952876:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b21 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.952881:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048635.952884:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b21 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.952891:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b21 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.952900:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151a600) 00010000:00010000:0.0:1789048635.952902:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789048635.952906:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b21 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.952911:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b21 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048635.954375:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+22:12363:x1875953097729536:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 78635us (78873us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1789048635.954391:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 200 00000020:00080000:0.0:1789048635.954397:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789048635.955515:0:13779:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789048635.955524:0:13779:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789048635.956225:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:1.0:1789048635.956239:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789048635.960967:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048635.961224:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097730176 00000100:00100000:2.0:1789048635.961241:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097730176 00000100:00100000:2.0:1789048635.961318:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:2.0:1789048635.961387:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b2a8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+22:12363:x1875953097730176:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789048635.962035:0:6500:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789048635.962223:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00010000:00010000:2.0:1789048635.962275:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b36 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.962299:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.962315:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.962326:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b36 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.962486:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b36 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.962494:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b36 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048635.962687:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789048635.962860:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b2a8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+24:12363:x1875953097730176:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 1466us (1908us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1789048635.962871:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 50 00000020:00080000:2.0:1789048635.962878:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789048635.969030:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048635.969049:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b36 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.969064:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1400 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048635.969088:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b36 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.976306:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b36 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.976352:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff959c3ef4a600) 00010000:00010000:0.0:1789048635.976356:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789048635.976363:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b36 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048635.976370:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776b36 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048635.978837:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048635.978847:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048635.978855:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789048636.061962:0:13781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789048636.381561:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789048636.960055:0:13779:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789048636.960067:0:13779:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789048636.960185:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789048636.960200:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789048637.406501:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789048637.500950:0:14637:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789048637.500959:0:14637:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789048637.500985:0:14637:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789048637.500991:0:14637:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789048637.506008:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048637.506046:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048637.506071:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048637.506092:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048637.506108:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048637.506126:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048637.506149:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048637.506252:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097730560 00000100:00100000:0.0:1789048637.506262:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097730560 00000100:00100000:0.0:1789048637.506322:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097731072 00000100:00100000:0.0:1789048637.506325:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097731072 00000100:00100000:0.0:1789048637.506362:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097730432 00000100:00100000:0.0:1789048637.506366:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097730432 00000100:00100000:0.0:1789048637.506390:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097730944 00000100:00100000:0.0:1789048637.506392:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097730944 00000100:00100000:0.0:1789048637.506409:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 341 00000100:00100000:0.0:1789048637.506419:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2391:x1875953097730560:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048637.506502:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2391:x1875953097730560:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 83us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048637.506509:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 341 00000100:00100000:0.0:1789048637.506526:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 342 00000100:00100000:0.0:1789048637.506532:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2391:x1875953097731072:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048637.506555:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2391:x1875953097731072:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 24us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048637.506561:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 342 00000100:00100000:0.0:1789048637.506573:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 343 00000100:00100000:0.0:1789048637.506579:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+24:2391:x1875953097730432:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048637.506607:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+24:2391:x1875953097730432:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 28us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048637.506613:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 343 00000100:00100000:0.0:1789048637.506624:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 344 00000100:00100000:0.0:1789048637.506630:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2391:x1875953097730944:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048637.506652:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2391:x1875953097730944:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 23us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048637.506657:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 344 00000100:00100000:0.0:1789048637.506677:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097730816 00000100:00100000:0.0:1789048637.506680:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097730816 00000100:00100000:0.0:1789048637.506712:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097730688 00000100:00100000:0.0:1789048637.506715:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097730688 00000100:00100000:0.0:1789048637.506736:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 126 00000100:00100000:0.0:1789048637.506743:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2391:x1875953097730816:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048637.506767:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097730304 00000100:00100000:0.0:1789048637.506769:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2391:x1875953097730816:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048637.506771:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097730304 00000100:00100000:0.0:1789048637.506775:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 126 00000100:00100000:0.0:1789048637.506786:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 127 00000100:00100000:0.0:1789048637.506804:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2391:x1875953097730688:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048637.506812:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 400 00000100:00100000:1.0:1789048637.506818:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2391:x1875953097730304:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048637.506828:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2391:x1875953097730688:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 25us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048637.506833:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 127 00000100:00100000:1.0:1789048637.506838:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2391:x1875953097730304:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 22us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048637.506845:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 400 00000100:00080000:0.0:1789048637.506858:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789048637.506861:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789048637.506864:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789048637.506866:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048637.620776:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048637.620909:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097731328 00000100:00100000:2.0:1789048637.620920:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097731328 00000100:00100000:2.0:1789048637.620979:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 201 00000100:00100000:2.0:1789048637.620989:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+24:12381:x1875953097731328:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048637.621010:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048637.621030:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c08776b3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b299be expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048637.621132:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776b44 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048637.621147:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776b44 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048637.621161:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776b44 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048637.621181:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789048637.621282:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c08776b3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299be expref: 27 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048637.621300:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776b44 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299be expref: 26 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048637.621310:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:2.0:1789048637.621313:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789048637.621316:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb1000, rc 0) 00000100:00100000:2.0:1789048637.621409:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+26:12381:x1875953097731328:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 420us (644us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1789048637.621429:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 201 00000100:00100000:0.0:1789048637.632947:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048637.632981:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097731456 00000100:00100000:0.0:1789048637.632990:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097731456 00000100:00100000:0.0:1789048637.633037:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 202 00000100:00100000:0.0:1789048637.633047:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+26:12381:x1875953097731456:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:0.0:1789048637.633119:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b52 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633137:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633148:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633183:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776b59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633191:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776b59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633199:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776b59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633270:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776b60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633278:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776b60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633286:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776b60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789048637.633330:0:12131:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776b60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633372:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633379:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b52 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633386:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b52 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633393:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048637.633397:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b52 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633411:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b52 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633423:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:0.0:1789048637.633426:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048637.633431:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b52 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633438:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b52 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633450:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776b59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633457:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776b59 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633464:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776b59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633469:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048637.633472:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776b59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633478:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776b59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633485:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959c4151a600) 00010000:00010000:0.0:1789048637.633487:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048637.633490:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776b59 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633505:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776b59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633520:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776b60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633526:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776b60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633533:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776b60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633538:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048637.633541:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776b60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633547:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776b60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633555:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959c4151ac00) 00010000:00010000:0.0:1789048637.633557:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048637.633560:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776b60 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.633566:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776b60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048637.633634:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+26:12381:x1875953097731456:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 588us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048637.633641:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 202 00000100:00100000:3.0:1789048637.687933:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048637.687977:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097731712 00000100:00100000:3.0:1789048637.687987:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097731712 00000100:00100000:3.0:1789048637.688042:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 203 00000100:00100000:3.0:1789048637.688052:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+26:12384:x1875953097731712:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789048637.688073:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048637.688094:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776b67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b299c5 expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688165:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b6e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688181:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b6e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688192:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b6e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688207:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776b75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688214:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776b75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688221:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776b75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688349:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776b7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688359:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776b7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688381:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776b7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048637.688392:0:8649:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789048637.688468:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b6e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688476:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b6e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688482:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b6e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688488:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048637.688492:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b6e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688498:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b6e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688509:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:3.0:1789048637.688512:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048637.688517:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688522:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776b6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688534:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776b75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688539:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776b75 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688552:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776b75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688557:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3de00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048637.688560:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776b75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688565:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776b75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688572:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959b06bfcd00) 00010000:00010000:3.0:1789048637.688574:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048637.688577:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776b75 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688582:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776b75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688624:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776b67 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299c5 expref: 29 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688638:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776b7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299c5 expref: 28 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.688661:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959b06bfc400) 00010000:00010000:3.0:1789048637.688663:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789048637.688665:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3ca00, rc 0) 00000100:00100000:3.0:1789048637.688724:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+28:12384:x1875953097731712:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 673us (802us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789048637.688740:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 203 00000100:00100000:0.0:1789048637.698961:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048637.699755:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097731840 00000100:00100000:3.0:1789048637.699766:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097731840 00000100:00100000:3.0:1789048637.699831:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 204 00000100:00100000:3.0:1789048637.699841:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+28:12384:x1875953097731840:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:3.0:1789048637.699925:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776b8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.699942:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776b8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.699953:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776b8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.699985:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776b8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.699993:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776b8a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.700000:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776b8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.700006:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048637.700010:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776b8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.700018:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776b8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.700029:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959b06bfc400) 00010000:00010000:3.0:1789048637.700039:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789048637.700045:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776b8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.700051:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776b8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048637.700117:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+28:12384:x1875953097731840:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 277us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048637.700125:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 204 00000100:00100000:0.0:1789048637.706100:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048637.706616:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097732096 00000100:00100000:3.0:1789048637.706626:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097732096 00000100:00100000:3.0:1789048637.707994:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:3.0:1789048637.708008:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+28:12384:x1875953097732096:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1789048637.708208:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+29:12384:x1875953097732096:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 205us (2120us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789048637.708213:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:3.0:1789048637.777895:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048637.779039:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097732352 00000100:00100000:0.0:1789048637.779053:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097732352 00000100:00100000:0.0:1789048637.779178:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 205 00000100:00100000:0.0:1789048637.779190:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+29:11908:x1875953097732352:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048637.779218:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048637.779239:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776b91 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b299cc expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.779377:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b98 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.779392:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776b7c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299c5 expref: 30 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.779415:0:6499:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b98 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.779449:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776b7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299c5 expref: 30 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.779472:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776b7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299c5 expref: 30 pid: 8649 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048637.779486:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08887800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875953111421568:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789048637.779601:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3e240 going to sleep for 11 seconds 00000100:00100000:1.0:1789048637.787248:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048637.788282:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097732480 00000100:00100000:3.0:1789048637.788294:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097732480 00010000:00010000:3.0:1789048637.788364:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776b7c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299c5 expref: 31 pid: 8649 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048637.788473:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 93 00000100:00100000:3.0:1789048637.788484:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+31:2394:x1875953097732480:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048637.788499:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048637.788506:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776b7c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299c5 expref: 31 pid: 8649 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.788540:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776b7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299c5 expref: 31 pid: 8649 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.788563:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959b06bfc400) 00010000:00010000:3.0:1789048637.788568:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b98 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.788579:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.788586:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b98 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.788607:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048637.788686:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+31:2394:x1875953097732480:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 202us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048637.788694:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 93 00010000:00010000:0.0:1789048637.790235:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776b7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299c5 expref: 30 pid: 8649 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048637.790274:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08887800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875953111421568:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048637.790295:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.790305:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.790310:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048637.790386:0:6499:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789048637.790518:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776b91 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299cc expref: 31 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.790534:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b98 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299cc expref: 30 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.790543:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959b06bfc400) 00010000:00010000:0.0:1789048637.790546:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789048637.790549:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38600, rc 0) 00000100:00100000:0.0:1789048637.790599:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+30:11908:x1875953097732352:12345-192.168.202.16@tcp:101:bash.0 Request processed in 11411us (12714us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789048637.790607:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 205 00000100:00100000:1.0:1789048637.799967:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048637.800193:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097732608 00000100:00100000:3.0:1789048637.800203:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097732608 00000100:00100000:3.0:1789048637.800260:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 206 00000100:00100000:3.0:1789048637.800271:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+30:11908:x1875953097732608:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1789048637.800296:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048637.800320:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08776ba6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b299d3 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.800377:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837e00/0x133f221c08776bad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.800414:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837e00/0x133f221c08776bad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.800428:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837e00/0x133f221c08776bad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.800527:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08776ba6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299d3 expref: 32 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.800542:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837e00/0x133f221c08776bad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299d3 expref: 31 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.800548:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959b06bfc400) 00010000:00010000:3.0:1789048637.800550:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789048637.800553:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02837e00, rc 0) 00000100:00100000:3.0:1789048637.800636:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+31:11908:x1875953097732608:12345-192.168.202.16@tcp:101:bash.0 Request processed in 368us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048637.800641:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 206 00000100:00100000:1.0:1789048637.803716:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048637.803939:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097732864 00000100:00100000:0.0:1789048637.803949:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097732864 00000100:00100000:0.0:1789048637.804065:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 207 00000100:00100000:0.0:1789048637.804076:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+31:11908:x1875953097732864:12345-192.168.202.16@tcp:36:bash.0 00010000:00010000:0.0:1789048637.804368:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776bb4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.804385:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.804414:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789048637.804458:0:12131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967481 00000004:00010000:0.0:1789048637.804480:0:12131:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000509b92b0 reply state 000000001597b887 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.804493:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776bb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.804500:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959b06bfc400) 00010000:00010000:0.0:1789048637.804503:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789048637.804507:0:12131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789048637.804545:0:12131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967482 00000100:00100000:0.0:1789048637.804629:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+35:11908:x1875953097732864:12345-192.168.202.16@tcp:36:bash.0 Request processed in 555us (922us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789048637.804636:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 207 00000020:00080000:0.0:1789048637.804640:0:12131:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789048637.817026:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048637.817268:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097732992 00000100:00100000:0.0:1789048637.817279:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097732992 00000100:00100000:0.0:1789048637.817395:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 208 00000100:00100000:0.0:1789048637.817415:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+35:11908:x1875953097732992:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048637.817440:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048637.817461:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776bbb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b299da expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.817533:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776bbb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299da expref: 36 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.817550:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776bbb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299da expref: 36 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.817569:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959b06bfc400) 00010000:00010000:0.0:1789048637.817573:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789048637.817577:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39200, rc 0) 00000100:00100000:0.0:1789048637.817629:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+36:11908:x1875953097732992:12345-192.168.202.16@tcp:101:bash.0 Request processed in 217us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048637.817635:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 208 00000100:00100000:1.0:1789048637.838027:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048637.838143:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097733120 00000100:00100000:0.0:1789048637.838154:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097733120 00000100:00100000:0.0:1789048637.838232:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:0.0:1789048637.838243:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:11908:x1875953097733120:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048637.838271:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048637.838293:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08776bc2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b299e1 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789048637.838319:0:8413:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x18d3fa4141254a40, atime: 0x18d3fa40ed0b2380, ctime: 0x18d3fa4141254a40, blocks: 0x8 00010000:00010000:0.0:1789048637.838380:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=392s v=(0 0) 00010000:00010000:0.0:1789048637.838386:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048637.838393:0:8413:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08776bc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299e1 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.838441:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08776bc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299e1 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.838454:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39600, rc 0) 00000100:00100000:0.0:1789048637.838509:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:11908:x1875953097733120:12345-192.168.202.16@tcp:101:bash.0 Request processed in 268us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048637.838516:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:1.0:1789048637.844189:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048637.844307:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097733248 00000100:00100000:2.0:1789048637.844316:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097733248 00002000:00010000:2.0:1789048637.844394:0:8419:0:(ofd_dev.c:2841:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1789048637.844399:0:8419:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959c3fba4a80 with x1875953097733248 ext(0->18446744073709551615) 00002000:00010000:2.0:1789048637.844411:0:8419:0:(ofd_dev.c:2846:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff959c3fba4a80. 00000100:00100000:2.0:1789048637.844446:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:2.0:1789048637.844456:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2393:x1875953097733248:12345-192.168.202.16@tcp:10:bash.0 00002000:00010000:2.0:1789048637.844691:0:8419:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789048637.844695:0:8419:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789048635169000000 -> 1789048638416000000 00002000:00010000:2.0:1789048637.844698:0:8419:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1789048633758000000 -> 1789048633758000000 00002000:00010000:2.0:1789048637.844700:0:8419:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789048635169000000 -> 1789048638416000000 00002000:00010000:2.0:1789048637.844703:0:8419:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789048637.844761:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:2393:x1875953097733248:12345-192.168.202.16@tcp:10:bash.0 Request processed in 306us (581us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789048637.844768:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00002000:00010000:2.0:1789048637.844771:0:8419:0:(ofd_dev.c:2841:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1789048637.844774:0:8419:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959c3fba4a80 with x1875953097733248 ext(0->18446744073709551615) 00002000:00010000:2.0:1789048637.844778:0:8419:0:(ofd_dev.c:2846:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff959c3fba4a80. 00000100:00100000:1.0:1789048637.925064:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048637.925760:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097733376 00000100:00100000:3.0:1789048637.925772:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097733376 00000100:00100000:3.0:1789048637.925889:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 209 00000100:00100000:3.0:1789048637.925900:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+36:12398:x1875953097733376:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:3.0:1789048637.925973:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08776bc9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.925991:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08776bc9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926022:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08776bc9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926054:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776bd0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926062:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926068:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926154:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776bd7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926164:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926171:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789048637.926228:0:6498:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926240:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08776bc9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926247:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08776bc9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926253:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08776bc9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926270:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048637.926274:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08776bc9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926282:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08776bc9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926293:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:3.0:1789048637.926296:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048637.926302:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08776bc9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926308:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08776bc9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926322:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926328:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776bd0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926376:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926382:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048637.926385:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926391:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776bd0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926410:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959b06bfcd00) 00010000:00010000:3.0:1789048637.926413:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048637.926416:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776bd0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926422:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08776bd0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926438:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926444:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776bd7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926450:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926455:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048637.926458:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926463:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776bd7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926471:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959b06bfc400) 00010000:00010000:3.0:1789048637.926473:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048637.926476:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776bd7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048637.926481:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837800/0x133f221c08776bd7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048637.926565:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+36:12398:x1875953097733376:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 666us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048637.926573:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 209 00000100:00100000:1.0:1789048637.984295:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048637.984467:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097733632 00000100:00100000:0.0:1789048637.984477:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097733632 00000100:00100000:0.0:1789048637.984534:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 210 00000100:00100000:0.0:1789048637.984543:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+36:12401:x1875953097733632:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789048637.984562:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048637.984582:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776bde lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b299e8 expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.984646:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776be5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.984660:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776be5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.984672:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776be5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.984687:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776bec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.984709:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776bec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.984715:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776bec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.984936:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776bf3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.984947:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.984955:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048637.984967:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789048637.985671:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776be5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.985681:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776be5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.985689:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776be5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.985696:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048637.985700:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776be5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.985706:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776be5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.985732:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:0.0:1789048637.985734:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048637.985739:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776be5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.985746:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776be5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.985761:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776bec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.985767:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776bec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.985772:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776bec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.985777:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048637.985780:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776bec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.985796:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776bec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.985812:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959c4151ab00) 00010000:00010000:0.0:1789048637.985814:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048637.985817:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776bec lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.985822:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776bec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.985886:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776bde lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299e8 expref: 39 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.985900:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299e8 expref: 38 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.985908:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959b06bfc400) 00010000:00010000:0.0:1789048637.985910:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789048637.985913:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38200, rc 0) 00000100:00100000:0.0:1789048637.985986:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+38:12401:x1875953097733632:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1442us (1697us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1789048637.985995:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 210 00000100:00100000:3.0:1789048637.990683:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048637.990773:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097733760 00000100:00100000:0.0:1789048637.990782:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097733760 00000100:00100000:0.0:1789048637.990856:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 211 00000100:00100000:0.0:1789048637.990863:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+38:12401:x1875953097733760:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:0.0:1789048637.990921:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.990933:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b98 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299cc expref: 38 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.990939:0:6499:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c01 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.990964:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b98 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299cc expref: 38 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.990990:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b98 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299cc expref: 38 pid: 6499 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048637.991002:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08887800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875953111421696:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789048637.991085:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048637.994129:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048637.994206:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097734016 00000100:00100000:2.0:1789048637.994213:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097734016 00000100:00100000:2.0:1789048637.994260:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:2.0:1789048637.994270:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+39:6166:x1875953097734016:12345-192.168.202.16@tcp:35:ldlm_bl.0 00000001:00080000:2.0:1789048637.994543:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967485 00000100:00100000:2.0:1789048637.994670:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+41:6166:x1875953097734016:12345-192.168.202.16@tcp:35:ldlm_bl.0 Request processed in 399us (546us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789048637.994678:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 52 00000020:00080000:2.0:1789048637.994683:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789048637.995394:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08887800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875953111421696:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048637.995415:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048637.997476:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048637.997618:0:13167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097734144 00000100:00100000:2.0:1789048637.997626:0:13167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097734144 00010000:00010000:2.0:1789048637.997660:0:13167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b98 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299cc expref: 41 pid: 6499 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048637.997693:0:13167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 94 00000100:00100000:2.0:1789048637.997700:0:13167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+41:2393:x1875953097734144:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048637.997712:0:13167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048637.997717:0:13167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b98 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299cc expref: 41 pid: 6499 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048637.997726:0:13167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b98 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299cc expref: 41 pid: 6499 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048637.997744:0:13167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776b98 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299cc expref: 41 pid: 6499 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048637.997759:0:13167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959b06bfc400) 00010000:00010000:2.0:1789048637.997762:0:13167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048637.997772:0:13167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048637.997779:0:13167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c01 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048637.997948:0:13167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048637.997994:0:13167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+40:2393:x1875953097734144:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 294us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048637.997999:0:13167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 94 00010000:00010000:0.0:1789048637.998924:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.998932:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.998966:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.998970:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c01 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.998976:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.998980:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048637.998983:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.998987:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c01 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.999006:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959b06bfc400) 00010000:00010000:0.0:1789048637.999008:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789048637.999011:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c01 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048637.999015:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c01 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048637.999093:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+39:12401:x1875953097733760:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 8230us (8417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048637.999100:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 211 00000100:00100000:1.0:1789048638.002322:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048638.002552:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097734400 00000100:00100000:2.0:1789048638.002562:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097734400 00000100:00100000:2.0:1789048638.002622:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:2.0:1789048638.002633:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+39:12401:x1875953097734400:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789048638.002886:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+40:12401:x1875953097734400:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 253us (571us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1789048638.002893:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:1.0:1789048638.082476:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048638.082553:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097734656 00000100:00100000:0.0:1789048638.082564:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097734656 00000100:00100000:0.0:1789048638.082678:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 212 00000100:00100000:0.0:1789048638.082689:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+40:12412:x1875953097734656:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:0.0:1789048638.082712:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048638.082737:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c08 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b299ef expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.082848:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c0f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.082865:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.082878:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.082893:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.082908:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.082915:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.083025:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776c1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.083035:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776c1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.083042:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776c1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048638.083050:0:8649:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1789048638.083132:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.083139:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c0f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.083146:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c0f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.083151:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048638.083155:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c0f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.083162:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c0f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.083182:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:0.0:1789048638.083185:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048638.083190:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.083196:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.083278:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.083285:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c16 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.083292:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.083297:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048638.083300:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.083306:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.083314:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959c4151ab00) 00010000:00010000:0.0:1789048638.083317:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048638.083319:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c16 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.083325:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.083442:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299ef expref: 43 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.083456:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776c1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299ef expref: 42 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.083464:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959b06bfc400) 00010000:00010000:0.0:1789048638.083467:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048638.083470:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38e00, rc 0) 00000100:00100000:0.0:1789048638.083534:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+42:12412:x1875953097734656:12345-192.168.202.16@tcp:101:cat.0 Request processed in 846us (1068us total) trans 4294967488 rc 0/0 00000100:00100000:0.0:1789048638.083542:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 212 00000100:00100000:1.0:1789048638.090832:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048638.090979:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097734912 00000100:00100000:2.0:1789048638.090989:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097734912 00000100:00100000:2.0:1789048638.091143:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:2.0:1789048638.091155:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+42:12412:x1875953097734912:12345-192.168.202.16@tcp:35:cat.0 00000100:00100000:2.0:1789048638.091434:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+43:12412:x1875953097734912:12345-192.168.202.16@tcp:35:cat.0 Request processed in 282us (614us total) trans 4294967489 rc 0/0 00000100:00100000:2.0:1789048638.091440:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:1.0:1789048638.116028:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048638.116157:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097735168 00000100:00100000:0.0:1789048638.116167:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097735168 00000100:00100000:0.0:1789048638.116238:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 213 00000100:00100000:0.0:1789048638.116248:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+43:12413:x1875953097735168:12345-192.168.202.16@tcp:36:rm.0 00010000:00010000:0.0:1789048638.116308:0:12131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1789048638.116374:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776bbb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299da expref: 43 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.116398:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776c1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299ef expref: 42 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.116412:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776bf3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299e8 expref: 41 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.116447:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837e00/0x133f221c08776bad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299d3 expref: 40 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.116458:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959b06bfc400) 00010000:00010000:0.0:1789048638.116463:0:12131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789048638.116485:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c2b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.116512:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c2b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.116522:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c2b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.116536:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c32 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.116543:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.116550:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.116627:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c39 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.116635:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c39 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.116791:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c39 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789048638.117082:0:12131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1789048638.117090:0:12131:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 392870756405ns, next at 393870754289ns, rc = 0 00010000:00010000:0.0:1789048638.117130:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776c40 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.117139:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776c40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.117147:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776c40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.117154:0:12131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776c40 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.117160:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776c40 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.117165:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776c40 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.117178:0:12131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789048638.117198:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c39 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.117204:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c39 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.117211:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c39 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.117216:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048638.117227:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c39 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.117235:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c39 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.117243:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959b06bfc400) 00010000:00010000:0.0:1789048638.117245:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789048638.117248:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c39 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.117252:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c39 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.117263:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c2b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.117267:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c2b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.117270:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c2b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.117273:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048638.117275:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c2b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.117278:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c2b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.117282:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:0.0:1789048638.117283:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048638.117289:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c2b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.117293:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c2b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789048638.117298:0:12131:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000d19f8280 reply state 00000000803a7eba transno 4294967490 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.117306:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c32 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.117311:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959c4151ab00) 00010000:00010000:0.0:1789048638.117312:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789048638.117314:0:12131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789048638.117607:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048638.117614:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776c40 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048638.117620:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048638.117623:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776c40 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048638.117630:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776c40 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048638.117639:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959b06bfc400) 00010000:00010000:1.0:1789048638.117641:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789048638.117645:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776c40 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048638.117650:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776c40 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048638.117662:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048638.117670:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048638.117672:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048638.117774:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+41:12413:x1875953097735168:12345-192.168.202.16@tcp:36:rm.0 Request processed in 1525us (1753us total) trans 4294967490 rc 0/0 00000100:00100000:0.0:1789048638.117781:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 213 00000100:00100000:1.0:1789048638.162262:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048638.162376:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097735424 00000100:00100000:0.0:1789048638.162387:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097735424 00000100:00100000:0.0:1789048638.162450:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 214 00000100:00100000:0.0:1789048638.162461:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+41:12419:x1875953097735424:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048638.162495:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048638.162517:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c47 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b299f6 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.162649:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c4e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.162666:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c4e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.162699:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c4e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.162712:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776c55 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.162721:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776c55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.162727:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776c55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789048638.163664:0:6499:0:(osp_object.c:1667:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1789048638.164726:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776c5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.164746:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.164757:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.166738:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c4e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.166756:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c4e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.166763:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c4e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.166769:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048638.166811:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c4e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.166820:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c4e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.166843:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:0.0:1789048638.166847:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048638.166851:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c4e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.166858:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c4e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789048638.166877:0:6499:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000cda9ea52 reply state 0000000032e17bab transno 4294967491 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776c55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.166888:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776c55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.166895:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959c4151ab00) 00010000:00010000:0.0:1789048638.166898:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789048638.166901:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789048638.167766:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08776c47 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299f6 expref: 44 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.170458:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776c5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299f6 expref: 43 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.170480:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c4151a900) 00010000:00010000:0.0:1789048638.170483:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048638.170507:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38e00, rc 0) 00000100:00100000:0.0:1789048638.170584:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+44:12419:x1875953097735424:12345-192.168.202.16@tcp:101:bash.0 Request processed in 8122us (8332us total) trans 4294967491 rc 0/0 00000100:00100000:0.0:1789048638.170593:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 214 00000100:00100000:1.0:1789048638.179064:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048638.179230:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097735552 00000100:00100000:0.0:1789048638.179241:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097735552 00000100:00100000:0.0:1789048638.179366:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:0.0:1789048638.179377:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2393:x1875953097735552:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048638.179397:0:8804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048638.179420:0:8804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c08776c6a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b299fd expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789048638.179447:0:8804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048638.179467:0:8804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=392s v=(0 0) 00010000:00010000:0.0:1789048638.179472:0:8804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048638.179480:0:8804:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c08776c6a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299fd expref: 8 pid: 8804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.179500:0:8804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c08776c6a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299fd expref: 8 pid: 8804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.179513:0:8804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39000, rc 0) 00000100:00100000:0.0:1789048638.179614:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2393:x1875953097735552:12345-192.168.202.16@tcp:101:bash.0 Request processed in 238us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048638.179622:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:1.0:1789048638.183259:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048638.183851:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097735680 00000100:00100000:0.0:1789048638.183860:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097735680 00000100:00100000:0.0:1789048638.183946:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:0.0:1789048638.183957:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:12419:x1875953097735680:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048638.183978:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048638.183999:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068aff6dc/0x133f221c08776c71 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a04 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.184038:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c08776c6a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299fd expref: 9 pid: 8804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.184045:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048638.184049:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048638.184053:0:8413:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068aff6dc/0x133f221c08776c71 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a04 expref: 9 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.184081:0:8413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c08776c6a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299fd expref: 9 pid: 8804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.184092:0:8413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c08776c6a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299fd expref: 9 pid: 8804 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048638.184102:0:8413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08887800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1875953111421824:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789048638.184506:0:8413:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3e240 going to sleep for 11 seconds 00000100:00100000:1.0:1789048638.189708:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048638.190382:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097735808 00000100:00100000:2.0:1789048638.190392:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097735808 00010000:00010000:2.0:1789048638.190439:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c08776c6a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299fd expref: 10 pid: 8804 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048638.190484:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 95 00000100:00100000:2.0:1789048638.190495:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+10:2394:x1875953097735808:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048638.190525:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048638.190548:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c08776c6a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299fd expref: 10 pid: 8804 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.190561:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c08776c6a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299fd expref: 10 pid: 8804 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.190584:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048638.190589:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048638.190599:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000068aff6dc/0x133f221c08776c71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a04 expref: 10 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.190610:0:6482:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068aff6dc/0x133f221c08776c71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a04 expref: 10 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.190650:0:6482:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000068aff6dc/0x133f221c08776c71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a04 expref: 10 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048638.190665:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6482:1875953111421952:192.168.202.16@tcp:105: 00000100:00100000:2.0:1789048638.190813:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c034fd840 going to sleep for 11 seconds 00010000:00010000:0.0:1789048638.192458:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000761c5259/0x133f221c08776c6a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299fd expref: 10 pid: 8804 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048638.192479:0:8413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08887800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1875953111421824:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048638.192526:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000068aff6dc/0x133f221c08776c71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a04 expref: 9 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.192539:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38800, rc 0) 00000100:00100000:0.0:1789048638.192589:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:12419:x1875953097735680:12345-192.168.202.16@tcp:101:bash.0 Request processed in 8634us (9342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048638.192597:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:1.0:1789048638.195398:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048638.195490:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097736064 00000100:00100000:0.0:1789048638.195500:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097736064 00000100:00100000:0.0:1789048638.195560:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:0.0:1789048638.195570:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+44:12419:x1875953097736064:12345-192.168.202.16@tcp:35:bash.0 00000001:00080000:0.0:1789048638.195807:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1789048638.195945:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+46:12419:x1875953097736064:12345-192.168.202.16@tcp:35:bash.0 Request processed in 376us (555us total) trans 4294967493 rc 0/0 00000100:00100000:0.0:1789048638.195953:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 55 00000020:00080000:0.0:1789048638.195958:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789048638.196882:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6482:1875953111421952:192.168.202.16@tcp:105: 00010000:00010000:2.0:1789048638.196907:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048638.197142:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2394:x1875953097735808:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6647us (7449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048638.197152:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 95 00000100:00100000:1.0:1789048638.349258:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048638.349472:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097736192 00000100:00100000:0.0:1789048638.349485:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097736192 00000100:00100000:0.0:1789048638.349599:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 215 00000100:00100000:0.0:1789048638.349610:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+46:12435:x1875953097736192:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789048638.349642:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048638.349665:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a0b expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.349747:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776c7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.349779:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776c7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.349803:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776c7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048638.349849:0:8649:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789048638.349853:0:8649:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789048638.350005:0:8649:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776c7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.350043:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a0b expref: 48 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.350062:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776c7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a0b expref: 47 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.350071:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:0.0:1789048638.350074:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789048638.350078:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39200, rc 0) 00000100:00100000:0.0:1789048638.350160:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+47:12435:x1875953097736192:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 552us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048638.350168:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 215 00000100:00100000:1.0:1789048638.354870:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048638.354952:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097736448 00000100:00100000:0.0:1789048638.354962:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097736448 00000100:00100000:0.0:1789048638.355025:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 216 00000100:00100000:0.0:1789048638.355045:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+47:12435:x1875953097736448:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789048638.355067:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048638.355107:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776c86 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a12 expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.355400:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.355416:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.355429:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048638.355442:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789048638.355557:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08776c86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a12 expref: 50 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.355575:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a12 expref: 49 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.355583:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c4151a900) 00010000:00010000:0.0:1789048638.355587:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048638.355590:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39000, rc 0) 00000100:00100000:0.0:1789048638.355655:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+49:12435:x1875953097736448:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 622us (794us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1789048638.355663:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 216 00000100:00100000:1.0:1789048638.360164:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048638.360397:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097736704 00000100:00100000:0.0:1789048638.360407:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097736704 00000100:00100000:0.0:1789048638.360479:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 217 00000100:00100000:0.0:1789048638.360489:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+49:12435:x1875953097736704:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789048638.360535:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048638.360574:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365200/0x133f221c08776c9b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a19 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.360696:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c08776ca2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.360710:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c08776ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.360723:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c08776ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048638.360736:0:6499:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789048638.360852:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365200/0x133f221c08776c9b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a19 expref: 52 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.360882:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c08776ca2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a19 expref: 51 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.360890:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c4151a900) 00010000:00010000:0.0:1789048638.360893:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789048638.360897:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08364a00, rc 0) 00000100:00100000:0.0:1789048638.360960:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+51:12435:x1875953097736704:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 472us (807us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1789048638.360967:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 217 00000100:00100000:1.0:1789048638.366485:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048638.366634:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097736832 00000100:00100000:3.0:1789048638.366644:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097736832 00000100:00100000:3.0:1789048638.366775:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:3.0:1789048638.366797:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c07cf7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+51:2394:x1875953097736832:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048638.366815:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048638.366987:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08776c8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a12 expref: 51 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.367008:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c4151a900) 00010000:00010000:3.0:1789048638.367014:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048638.367159:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c07cf7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+50:2394:x1875953097736832:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 374us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048638.367167:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:1.0:1789048638.368666:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048638.369064:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097736960 00000100:00100000:2.0:1789048638.369074:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097736960 00000100:00100000:2.0:1789048638.369128:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:2.0:1789048638.369138:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2393:x1875953097736960:12345-192.168.202.16@tcp:1:lfs.0 00010000:00010000:2.0:1789048638.369187:0:8414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c08776cb0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.369210:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068aff6dc/0x133f221c08776c71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a04 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.369218:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789048638.369223:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789048638.369228:0:8414:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c08776cb0 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.369262:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068aff6dc/0x133f221c08776c71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a04 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.369276:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068aff6dc/0x133f221c08776c71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a04 expref: 8 pid: 8413 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048638.369290:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1875953111422080:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789048638.369397:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c034fd840 going to sleep for 11 seconds 00000100:00100000:1.0:1789048638.372594:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048638.372660:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1875953111422080:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789048638.372697:0:8414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c08776cb0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048638.372699:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097737088 00000100:00100000:3.0:1789048638.372707:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097737088 00002000:00100000:3.0:1789048638.372756:0:8417:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff959b08108e00 x1875953097737088/t0(0) o4->85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp:649/0 lens 504/0 e 0 to 0 dl 1789048649 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789048638.372764:0:8417:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b08108e00 with x1875953097737088 ext(0->8) 00010000:00010000:3.0:1789048638.372770:0:8417:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000068aff6dc/0x133f221c08776c71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a04 expref: 9 pid: 8413 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.372802:0:8417:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000068aff6dc/0x133f221c08776c71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a04 expref: 9 pid: 8413 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789048638.372810:0:8417:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff959b08108e00 00000100:00100000:3.0:1789048638.372846:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:3.0:1789048638.372857:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:2393:x1875953097737088:12345-192.168.202.16@tcp:4:lfs.0 00000001:00080000:1.0:1789048638.375938:0:9492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1789048638.375960:0:9492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1789048638.376455:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2393:x1875953097737088:12345-192.168.202.16@tcp:4:lfs.0 Request processed in 3594us (3863us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789048638.376467:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00002000:00100000:0.0:1789048638.376493:0:8417:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff959b08108e00 x1875953097737088/t4294967309(0) o4->85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp:649/0 lens 504/448 e 0 to 0 dl 1789048649 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789048638.376505:0:8417:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b08108e00 with x1875953097737088 ext(0->8) 00010000:00010000:0.0:1789048638.376515:0:8417:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000068aff6dc/0x133f221c08776c71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a04 expref: 7 pid: 8413 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.376535:0:8417:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000068aff6dc/0x133f221c08776c71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a04 expref: 7 pid: 8413 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789048638.376543:0:8417:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff959b08108e00 00000100:00100000:1.0:1789048638.382933:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048638.383256:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097737216 00000100:00100000:3.0:1789048638.383267:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097737216 00010000:00010000:3.0:1789048638.383312:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068aff6dc/0x133f221c08776c71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a04 expref: 7 pid: 8413 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048638.383394:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 96 00000100:00100000:3.0:1789048638.383403:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2391:x1875953097737216:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048638.383420:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789048638.383442:0:6481:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789048638.383450:0:6481:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789048638808653155 00002000:00010000:3.0:1789048638.383453:0:6481:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789048638981318439 00002000:00010000:3.0:1789048638.383455:0:6481:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789048638808653155 00002000:00010000:3.0:1789048638.383457:0:6481:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789048638.383464:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068aff6dc/0x133f221c08776c71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a04 expref: 7 pid: 8413 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.383478:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068aff6dc/0x133f221c08776c71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a04 expref: 7 pid: 8413 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.383525:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068aff6dc/0x133f221c08776c71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a04 expref: 7 pid: 8413 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.383545:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789048638.383550:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789048638.383556:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c08776cb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.383567:0:6481:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c08776cb0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.383601:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048638.383665:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+6:2391:x1875953097737216:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 263us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048638.383672:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 96 00010000:00010000:0.0:1789048638.383757:0:8414:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c08776cb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.383767:0:8414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c08776cb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.383799:0:8414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c08776cb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.383809:0:8414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c08776cb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.383818:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c08776cb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.383825:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048638.383838:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c08776cb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.383848:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c08776cb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.383861:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c08776cb0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.383943:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c08776cb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048638.383993:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097736960:12345-192.168.202.16@tcp:1:lfs.0 Request processed in 14857us (15334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048638.384001:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:1.0:1789048638.389607:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048638.390265:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097737472 00000100:00100000:3.0:1789048638.390275:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097737472 00000100:00100000:3.0:1789048638.390444:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:3.0:1789048638.390455:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b2a8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+50:12435:x1875953097737472:12345-192.168.202.16@tcp:35:lfs.0 00000004:00010000:3.0:1789048638.390527:0:6501:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c08776ca2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a19 expref: 50 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789048638.391050:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00000001:00080000:3.0:1789048638.391095:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967497 00000001:00080000:3.0:1789048638.391459:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967498 00010000:00010000:3.0:1789048638.391502:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776cb7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.391528:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776c5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299f6 expref: 54 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.391538:0:6501:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776cb7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.391570:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776c5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299f6 expref: 54 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.391585:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776c5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299f6 expref: 54 pid: 6499 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048638.391601:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6501:1875953111422208:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048638.393709:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2b027f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789048638.396590:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6501:1875953111422208:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789048638.396594:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:3.0:1789048638.396618:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776cb7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048638.396693:0:13167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097737600 00000100:00100000:2.0:1789048638.396702:0:13167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097737600 00010000:00010000:2.0:1789048638.396738:0:13167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776c5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299f6 expref: 55 pid: 6499 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048638.397311:0:13167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 97 00000100:00100000:2.0:1789048638.397322:0:13167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d310380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+55:2393:x1875953097737600:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048638.397365:0:13167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048638.397374:0:13167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776c5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299f6 expref: 55 pid: 6499 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.397387:0:13167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776c5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299f6 expref: 55 pid: 6499 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.397408:0:13167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08776c5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b299f6 expref: 55 pid: 6499 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.397422:0:13167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c4151a900) 00010000:00010000:2.0:1789048638.397427:0:13167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776cb7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.397436:0:13167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776cb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.397443:0:13167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776cb7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.397552:0:13167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048638.397622:0:13167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d310380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+54:2393:x1875953097737600:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 301us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048638.397629:0:13167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 97 00010000:00010000:0.0:1789048638.397712:0:6501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776cb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.397720:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776cb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789048638.397850:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000001:00080000:0.0:1789048638.398174:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000100:00100000:0.0:1789048638.398260:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08887800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1875953111422336:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789048638.398310:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048638.398493:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41497180 going to sleep for 11 seconds 00000100:00100000:3.0:1789048638.400756:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111422336 00000100:00100000:3.0:1789048638.400771:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111422336 00000100:00100000:0.0:1789048638.401219:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789048638.401232:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6501:x1875953111422336:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789048638.401430:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6501:x1875953111422336:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 201us (3119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048638.401438:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789048638.401531:0:6501:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:2.0:1789048638.401537:0:6501:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:2.0:1789048638.401559:0:6501:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff959b082ee300, transno 4294967308 00000100:00100000:2.0:1789048638.401574:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08887800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1875953111422336:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789048638.401719:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000100:00100000:2.0:1789048638.401808:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1875953111422464:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789048638.401844:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789048638.401898:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789048638.402193:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41497180 going to sleep for 11 seconds 00000100:00100000:1.0:1789048638.402278:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111422464 00000100:00100000:1.0:1789048638.402287:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111422464 00000100:00100000:1.0:1789048638.402319:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789048638.402327:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6501:x1875953111422464:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789048638.402495:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6501:x1875953111422464:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 168us (649us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789048638.402501:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789048638.402628:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1875953111422464:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789048638.402682:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00010000:00010000:2.0:1789048638.402719:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776cb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.402729:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776cb7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.402737:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776cb7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.402744:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3ca00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048638.402749:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776cb7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.402775:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776cb7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.402803:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c4151a900) 00010000:00010000:2.0:1789048638.402806:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789048638.402812:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776cb7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.402818:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776cb7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789048638.402938:0:6501:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789048638.402999:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1789048638.403012:0:6501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 393156678590ns, next at 394156676588ns, rc = 0 00000001:00080000:2.0:1789048638.403019:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967503 00010000:00010000:2.0:1789048638.403042:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c4151a900) 00010000:00010000:2.0:1789048638.403045:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789048638.403052:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c08776ca2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a19 expref: 58 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048638.403145:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b2a8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+57:12435:x1875953097737472:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 12691us (13547us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789048638.403152:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 56 00000020:00080000:2.0:1789048638.403156:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789048638.408525:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048638.408710:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097737728 00000100:00100000:0.0:1789048638.408720:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097737728 00000100:00100000:0.0:1789048638.408794:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 218 00000100:00100000:0.0:1789048638.408804:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+57:12435:x1875953097737728:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789048638.408838:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048638.408863:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365200/0x133f221c08776cbe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a20 expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.408921:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365200/0x133f221c08776cbe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a20 expref: 58 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.408937:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365200/0x133f221c08776cbe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a20 expref: 58 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.408956:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:0.0:1789048638.408959:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789048638.408963:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08365200, rc 0) 00000100:00100000:0.0:1789048638.409026:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+58:12435:x1875953097737728:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 224us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048638.409033:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 218 00000100:00100000:1.0:1789048638.412443:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048638.413978:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097737984 00000100:00100000:2.0:1789048638.413993:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097737984 00000100:00100000:2.0:1789048638.414125:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:2.0:1789048638.414136:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+58:12435:x1875953097737984:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789048638.414405:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+59:12435:x1875953097737984:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 270us (1970us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1789048638.414413:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 57 00010000:00010000:3.0:1789048638.429482:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048638.518580:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048638.518726:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097738112 00000100:00100000:0.0:1789048638.518737:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097738112 00000100:00100000:0.0:1789048638.518837:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 219 00000100:00100000:0.0:1789048638.518849:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+59:12445:x1875953097738112:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:0.0:1789048638.519077:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776cc5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519095:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519106:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519129:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776ccc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519138:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776ccc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519145:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776ccc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519215:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364000/0x133f221c08776cd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519223:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364000/0x133f221c08776cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519229:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364000/0x133f221c08776cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789048638.519282:0:12131:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364000/0x133f221c08776cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519295:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519311:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776cc5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519319:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776cc5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519326:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08365a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048638.519330:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776cc5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519380:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776cc5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519393:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:0.0:1789048638.519395:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048638.519399:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776cc5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519405:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776cc5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519419:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776ccc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519424:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776ccc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519430:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776ccc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519435:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08365000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048638.519442:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776ccc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519449:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776ccc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519456:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959c4151ab00) 00010000:00010000:0.0:1789048638.519458:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048638.519461:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776ccc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519466:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776ccc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519475:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364000/0x133f221c08776cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519480:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364000/0x133f221c08776cd3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519486:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364000/0x133f221c08776cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519490:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08364000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048638.519492:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364000/0x133f221c08776cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519498:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364000/0x133f221c08776cd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519504:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:0.0:1789048638.519506:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048638.519514:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364000/0x133f221c08776cd3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.519519:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364000/0x133f221c08776cd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048638.519580:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+59:12445:x1875953097738112:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 733us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048638.519587:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 219 00000100:00100000:1.0:1789048638.567316:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048638.567440:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097738368 00000100:00100000:3.0:1789048638.567453:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097738368 00000100:00100000:3.0:1789048638.567519:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 220 00000100:00100000:3.0:1789048638.567530:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+59:12448:x1875953097738368:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789048638.567549:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048638.567582:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776cda lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a27 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.567670:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776ce1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.567684:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.567696:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.567705:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776ce8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.567713:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.567719:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.567842:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776cef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.567851:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776cef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.567858:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776cef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048638.568219:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789048638.568305:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.568323:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776ce1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.568329:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.568368:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048638.568372:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.568380:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776ce1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.568393:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:3.0:1789048638.568396:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048638.568401:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776ce1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.568407:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776ce1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.568421:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.568427:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776ce8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.568433:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.568438:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3de00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048638.568447:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.568453:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776ce8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.568461:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959c4151ab00) 00010000:00010000:3.0:1789048638.568463:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048638.568466:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776ce8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.568472:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776ce8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.568514:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776cda lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a27 expref: 62 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.568527:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776cef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a27 expref: 61 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.568534:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:3.0:1789048638.568536:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789048638.568538:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3c400, rc 0) 00000100:00100000:3.0:1789048638.568724:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+61:12448:x1875953097738368:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1195us (1417us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1789048638.568732:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 220 00000100:00100000:1.0:1789048638.576224:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048638.576370:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097738496 00000100:00100000:3.0:1789048638.576381:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097738496 00000100:00100000:3.0:1789048638.576450:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 221 00000100:00100000:3.0:1789048638.576461:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+61:12448:x1875953097738496:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:3.0:1789048638.576546:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776cfd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.576564:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776cfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.576577:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776cfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.576614:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776cfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.576621:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776cfd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.576629:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776cfd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.576636:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048638.576640:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776cfd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.576648:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776cfd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.576659:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:3.0:1789048638.576662:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789048638.576667:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776cfd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.576673:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776cfd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048638.576764:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+61:12448:x1875953097738496:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 304us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048638.576772:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 221 00000100:00100000:1.0:1789048638.580659:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048638.580774:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097738752 00000100:00100000:0.0:1789048638.580798:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097738752 00000100:00100000:0.0:1789048638.580860:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:0.0:1789048638.580871:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+61:12448:x1875953097738752:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:0.0:1789048638.581131:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+62:12448:x1875953097738752:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 260us (480us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789048638.581139:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:1.0:1789048638.660455:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048638.660677:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097739008 00000100:00100000:0.0:1789048638.660739:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097739008 00000100:00100000:0.0:1789048638.660817:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 222 00000100:00100000:0.0:1789048638.660837:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2ae44c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+62:12458:x1875953097739008:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048638.660862:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048638.660865:0:12131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789048638.660894:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08776c7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a0b expref: 62 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.660914:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:0.0:1789048638.660919:0:12131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789048638.660935:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364000/0x133f221c08776d04 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a2e expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.661063:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d0b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.661079:0:12131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776cef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a27 expref: 62 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.661087:0:12131:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d0b lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.661121:0:12131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776cef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a27 expref: 62 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.661134:0:12131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776cef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a27 expref: 62 pid: 6498 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048638.661149:0:12131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08885c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12131:1875953111422592:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789048638.661391:0:12131:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0793a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789048638.664444:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048638.664530:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097739136 00000100:00100000:3.0:1789048638.664540:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097739136 00010000:00010000:3.0:1789048638.664582:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776cef lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a27 expref: 63 pid: 6498 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048638.664626:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 98 00000100:00100000:3.0:1789048638.664636:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+63:2394:x1875953097739136:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048638.664651:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048638.664658:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776cef lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a27 expref: 63 pid: 6498 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.664670:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776cef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a27 expref: 63 pid: 6498 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.664992:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:3.0:1789048638.664999:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d0b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.665010:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d0b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.665018:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d0b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.665201:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048638.665274:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+63:2394:x1875953097739136:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 639us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048638.665282:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 98 00010000:00010000:0.0:1789048638.667491:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776cef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a27 expref: 62 pid: 6498 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048638.667518:0:12131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08885c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12131:1875953111422592:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048638.667545:0:12131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d0b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.667554:0:12131:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d0b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.667581:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d0b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048638.667605:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789048638.667761:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364000/0x133f221c08776d04 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a2e expref: 63 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.667896:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d0b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a2e expref: 62 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.667906:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:0.0:1789048638.667909:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789048638.667912:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08365000, rc 0) 00000100:00100000:0.0:1789048638.667978:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2ae44c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+62:12458:x1875953097739008:12345-192.168.202.16@tcp:101:bash.0 Request processed in 7152us (7531us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1789048638.667986:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 222 00000100:00100000:1.0:1789048638.678154:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048638.678504:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097739264 00000100:00100000:3.0:1789048638.678517:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097739264 00000100:00100000:3.0:1789048638.678593:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 223 00000100:00100000:3.0:1789048638.678605:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+62:12458:x1875953097739264:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1789048638.678630:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048638.678652:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776d19 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a35 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.678698:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776d20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.678713:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776d20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.678726:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776d20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.678871:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776d19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a35 expref: 64 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.678899:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776d20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a35 expref: 63 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.678908:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:3.0:1789048638.678911:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789048638.678914:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3de00, rc 0) 00000100:00100000:3.0:1789048638.678988:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+63:12458:x1875953097739264:12345-192.168.202.16@tcp:101:bash.0 Request processed in 386us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048638.678995:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 223 00000100:00100000:1.0:1789048638.683424:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048638.683559:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097739520 00000100:00100000:2.0:1789048638.683569:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097739520 00000100:00100000:2.0:1789048638.683632:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 224 00000100:00100000:2.0:1789048638.683642:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+63:12458:x1875953097739520:12345-192.168.202.16@tcp:36:bash.0 00010000:00010000:2.0:1789048638.683936:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776d27 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.683955:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776d27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.683968:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776d27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789048638.684014:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000004:00010000:2.0:1789048638.684038:0:6499:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000be801000 reply state 000000003f84c428 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776d27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.684051:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776d27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.684059:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:2.0:1789048638.684062:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789048638.684066:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789048638.684159:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+66:12458:x1875953097739520:12345-192.168.202.16@tcp:36:bash.0 Request processed in 517us (745us total) trans 4294967510 rc 0/0 00000100:00100000:2.0:1789048638.684166:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 224 00000020:00080000:2.0:1789048638.684186:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789048638.688066:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048638.688241:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097739648 00000100:00100000:0.0:1789048638.688254:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097739648 00000100:00100000:0.0:1789048638.688321:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 225 00000100:00100000:0.0:1789048638.688369:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+66:12458:x1875953097739648:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048638.688396:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048638.688419:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364000/0x133f221c08776d2e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a3c expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.688513:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776d35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.688548:0:12131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d0b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a2e expref: 67 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.688558:0:12131:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776d35 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.688595:0:12131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d0b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a2e expref: 67 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.688609:0:12131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d0b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a2e expref: 67 pid: 12131 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048638.688624:0:12131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08886680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12131:1875953111422720:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789048638.688699:0:12131:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0793a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789048638.692976:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048638.693066:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097739776 00000100:00100000:3.0:1789048638.693079:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097739776 00010000:00010000:3.0:1789048638.693134:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d0b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a2e expref: 68 pid: 12131 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048638.693178:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 99 00000100:00100000:3.0:1789048638.693190:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+68:2394:x1875953097739776:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048638.693209:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048638.693218:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d0b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a2e expref: 68 pid: 12131 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.693232:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d0b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a2e expref: 68 pid: 12131 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.693258:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:3.0:1789048638.693264:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776d35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.693276:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776d35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.693283:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776d35 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.693304:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048638.693398:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+68:2394:x1875953097739776:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 210us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048638.693420:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 99 00010000:00010000:0.0:1789048638.693598:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d0b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a2e expref: 67 pid: 12131 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048638.693617:0:12131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08886680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12131:1875953111422720:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048638.693641:0:12131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776d35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.693650:0:12131:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776d35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.693657:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776d35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048638.693730:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789048638.693741:0:12131:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789048638.693770:0:12131:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776d35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.693813:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364000/0x133f221c08776d2e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a3c expref: 67 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.693828:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776d35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a3c expref: 66 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.693836:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:0.0:1789048638.693838:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048638.693841:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08365a00, rc 0) 00000100:00100000:0.0:1789048638.693870:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+66:12458:x1875953097739648:12345-192.168.202.16@tcp:101:bash.0 Request processed in 5540us (5817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048638.693877:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 225 00000100:00100000:1.0:1789048638.698262:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048638.698399:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097740032 00000100:00100000:0.0:1789048638.698409:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097740032 00000100:00100000:0.0:1789048638.698471:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:0.0:1789048638.698481:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+66:12458:x1875953097740032:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:0.0:1789048638.698990:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+67:12458:x1875953097740032:12345-192.168.202.16@tcp:35:bash.0 Request processed in 507us (736us total) trans 4294967511 rc 0/0 00000100:00100000:0.0:1789048638.698999:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:1.0:1789048638.780818:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048638.781531:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097740160 00000100:00100000:0.0:1789048638.781543:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097740160 00000100:00100000:0.0:1789048638.781660:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 226 00000100:00100000:0.0:1789048638.781673:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+67:12464:x1875953097740160:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789048638.781707:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048638.781742:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364000/0x133f221c08776d3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a43 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.781835:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.781851:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.781864:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048638.781910:0:6497:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789048638.781914:0:6497:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789048638.781935:0:6497:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.781962:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364000/0x133f221c08776d3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a43 expref: 69 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.781979:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a43 expref: 68 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048638.781988:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:0.0:1789048638.781992:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789048638.781995:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08365000, rc 0) 00000100:00100000:0.0:1789048638.782473:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+68:12464:x1875953097740160:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 801us (1663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048638.782482:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 226 00000100:00100000:3.0:1789048638.785805:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048638.786625:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097740288 00000100:00100000:2.0:1789048638.786637:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097740288 00000100:00100000:2.0:1789048638.786806:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 227 00000100:00100000:2.0:1789048638.786818:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+68:12464:x1875953097740288:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048638.786854:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048638.786877:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c08776d4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a4a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.786947:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776d51 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.786964:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776d51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.786979:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776d51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.786991:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776d58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.786999:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776d58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787005:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776d58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787123:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c08776d5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787132:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c08776d5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787155:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c08776d5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048638.787198:0:6499:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789048638.787202:0:6499:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789048638.787222:0:6499:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c08776d5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787234:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c08776d5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787242:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776d51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787248:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776d51 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787254:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776d51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787260:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048638.787264:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776d51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787271:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776d51 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787281:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:2.0:1789048638.787285:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048638.787289:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776d51 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787306:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776d51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787320:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776d58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787326:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776d58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787350:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776d58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787356:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048638.787359:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776d58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787365:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776d58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787373:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959c4151ab00) 00010000:00010000:2.0:1789048638.787375:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048638.787378:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776d58 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787384:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0600/0x133f221c08776d58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787412:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c08776d4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a4a expref: 70 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787426:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c08776d5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a4a expref: 69 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.787440:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:2.0:1789048638.787442:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789048638.787445:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb1c00, rc 0) 00000100:00100000:2.0:1789048638.787514:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+69:12464:x1875953097740288:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 698us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048638.787522:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 227 00000100:00100000:1.0:1789048638.793215:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048638.793270:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048638.793633:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097740544 00000100:00100000:3.0:1789048638.793647:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097740544 00000100:00100000:3.0:1789048638.793719:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 228 00000100:00100000:3.0:1789048638.793730:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+69:12464:x1875953097740544:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789048638.793750:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048638.793772:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776d66 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a51 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.793911:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776d6d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.793928:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776d35 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a3c expref: 70 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.793937:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c08776d5f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a4a expref: 70 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.793946:0:6498:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776d6d lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.793980:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c08776d5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a4a expref: 70 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.793994:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c08776d5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a4a expref: 70 pid: 6499 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048638.794030:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1875953111422848:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048638.794159:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776d35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a3c expref: 70 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.794167:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776d35 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a3c expref: 70 pid: 12131 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048638.794177:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1875953111422976:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048638.794200:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2b027f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789048638.794369:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097740672 00000100:00100000:3.0:1789048638.794374:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097740672 00010000:00010000:3.0:1789048638.794394:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c08776d5f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a4a expref: 71 pid: 6499 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048638.794416:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 100 00000100:00100000:3.0:1789048638.794423:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+71:2392:x1875953097740672:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048638.794432:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048638.794437:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c08776d5f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a4a expref: 71 pid: 6499 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.794448:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c08776d5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a4a expref: 71 pid: 6499 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.794464:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:3.0:1789048638.794468:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776d6d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.794480:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776d6d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.794486:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048638.794513:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+71:2392:x1875953097740672:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 90us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048638.794520:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 100 00000100:00100000:1.0:1789048638.799255:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048638.799291:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097740800 00000100:00100000:1.0:1789048638.799299:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097740800 00010000:00010000:1.0:1789048638.799368:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776d35 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a3c expref: 71 pid: 12131 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048638.799401:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 101 00000100:00100000:1.0:1789048638.799412:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+71:2394:x1875953097740800:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048638.799426:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048638.799433:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776d35 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a3c expref: 71 pid: 12131 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048638.799445:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776d35 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a3c expref: 71 pid: 12131 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048638.799470:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:1.0:1789048638.799491:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776d6d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048638.799502:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776d6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048638.799510:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776d6d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048638.799530:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048638.799582:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+71:2394:x1875953097740800:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 170us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048638.799590:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 101 00010000:00010000:3.0:1789048638.801906:0:6498:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.16@tcp) returned -22 from blocking AST (req@00000000f51f7a59 x1875953111422848) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c08776d5f lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a4a expref: 70 pid: 6499 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.801934:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1c00/0x133f221c08776d5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a4a expref: 70 pid: 6499 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048638.801950:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1875953111422848:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048638.801967:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365a00/0x133f221c08776d35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a3c expref: 69 pid: 12131 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048638.801977:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1875953111422976:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048638.802004:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:3.0:1789048638.802012:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776d6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.802021:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776d6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.802026:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776d6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048638.802198:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789048638.802483:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776d66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a51 expref: 70 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.802502:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776d6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a51 expref: 69 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.802511:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:3.0:1789048638.802513:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789048638.802516:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3d800, rc 0) 00000100:00100000:3.0:1789048638.802645:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+69:12464:x1875953097740544:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 8916us (9441us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1789048638.802655:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 228 00000100:00100000:1.0:1789048638.811085:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048638.811233:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097741056 00000100:00100000:3.0:1789048638.811244:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097741056 00000100:00100000:3.0:1789048638.811406:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:3.0:1789048638.811416:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c07cf4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+69:12464:x1875953097741056:12345-192.168.202.16@tcp:103:lfs.0 00010000:00010000:3.0:1789048638.811433:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048638.811458:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365200/0x133f221c08776cbe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a20 expref: 69 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.811480:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:3.0:1789048638.811486:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048638.811534:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c07cf4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+68:12464:x1875953097741056:12345-192.168.202.16@tcp:103:lfs.0 Request processed in 119us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048638.811540:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:1.0:1789048638.814475:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048638.814576:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097741184 00000100:00100000:3.0:1789048638.814589:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097741184 00000100:00100000:3.0:1789048638.814774:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 229 00000100:00100000:3.0:1789048638.814795:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+68:12464:x1875953097741184:12345-192.168.202.16@tcp:58:lfs.0 00010000:00010000:3.0:1789048638.814937:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776d7b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.814955:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776d7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048638.814968:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776d7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789048638.815093:0:8649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1789048638.815296:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+68:12464:x1875953097741184:12345-192.168.202.16@tcp:58:lfs.0 Request processed in 502us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048638.815305:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 229 00000100:00100000:1.0:1789048638.818480:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048638.818585:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097741312 00000100:00100000:2.0:1789048638.818595:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097741312 00000100:00100000:2.0:1789048638.818771:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 230 00000100:00100000:2.0:1789048638.818797:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+68:12464:x1875953097741312:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048638.818819:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048638.818911:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c08776d82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a58 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.818969:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776d7b lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.818980:0:6499:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c08776d82 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a58 expref: 69 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.818999:0:6499:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776d7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.819012:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c08776d82 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a58 expref: 69 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.819026:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:2.0:1789048638.819041:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789048638.819046:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c08776d82 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a58 expref: 69 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048638.819054:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb0e00, rc 0) 00000100:00100000:2.0:1789048638.819158:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+69:12464:x1875953097741312:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 366us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048638.819166:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 230 00000100:00100000:2.0:1789048638.941978:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111423360:0@lo:400:kworker.0 00000100:00100000:2.0:1789048638.942055:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048638.942108:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111423872:0@lo:400:kworker.0 00000100:00100000:2.0:1789048638.942136:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048638.942159:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111424384:0@lo:400:kworker.0 00000100:00100000:2.0:1789048638.942179:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048638.942203:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789048638.942208:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111423488:0@lo:400:kworker.0 00000100:00100000:2.0:1789048638.942225:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048638.942234:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111424000:0@lo:400:kworker.0 00000100:00100000:2.0:1789048638.942249:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048638.942258:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111424512:0@lo:400:kworker.0 00000100:00100000:2.0:1789048638.942268:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048638.942291:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111423360 00000100:00100000:2.0:1789048638.942298:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111423360 00000100:00100000:2.0:1789048638.942356:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789048638.942362:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111423360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048638.942404:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111423360:12345-0@lo:400:kworker.0 Request processed in 43us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048638.942423:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789048638.942459:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111423360:0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.942544:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111423232:0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.942575:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048638.942600:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875953111423744:0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.942620:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048638.942635:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111424256:0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.942653:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048638.942666:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789048638.942672:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111423104:0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.942702:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048638.942727:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111423616:0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.942748:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048638.942761:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111424128:0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.942789:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048638.942818:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111423104 00000100:00100000:0.0:1789048638.942822:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111423104 00000100:00100000:0.0:1789048638.942852:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1789048638.942858:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3623:x1875953111423104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.942894:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3623:x1875953111423104:12345-0@lo:400:kworker.0 Request processed in 36us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048638.942900:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1789048638.942929:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111423616 00000100:00100000:0.0:1789048638.942932:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111423616 00000100:00100000:0.0:1789048638.942953:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789048638.942959:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111423616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.942988:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111423616:12345-0@lo:400:kworker.0 Request processed in 29us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048638.943004:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789048638.943030:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111423104:0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.943039:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111423616:0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.943059:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111424000 00000100:00100000:0.0:1789048638.943063:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111424000 00000100:00100000:0.0:1789048638.943094:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111424512 00000100:00100000:0.0:1789048638.943097:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111424512 00000100:00100000:0.0:1789048638.943111:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111424128 00000100:00100000:0.0:1789048638.943114:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111424128 00000100:00100000:0.0:1789048638.943127:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789048638.943132:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111424000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.943164:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111424000:12345-0@lo:400:kworker.0 Request processed in 32us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048638.943170:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789048638.943182:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789048638.943187:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111424512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.943213:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111424512:12345-0@lo:400:kworker.0 Request processed in 26us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048638.943219:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789048638.943229:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789048638.943235:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111424128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.943256:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111424128:12345-0@lo:400:kworker.0 Request processed in 23us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048638.943260:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789048638.943276:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111424128:0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.943302:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111423872 00000100:00100000:0.0:1789048638.943304:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111423872 00000100:00100000:0.0:1789048638.943319:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111424384 00000100:00100000:0.0:1789048638.943321:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111424384 00000100:00100000:0.0:1789048638.943327:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111423488 00000100:00100000:0.0:1789048638.943329:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111423488 00000100:00100000:0.0:1789048638.943355:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111423232 00000100:00100000:0.0:1789048638.943357:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111423232 00000100:00100000:0.0:1789048638.943362:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111423744 00000100:00100000:0.0:1789048638.943364:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111423744 00000100:00100000:0.0:1789048638.943370:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111424256 00000100:00100000:0.0:1789048638.943371:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111424256 00000100:00100000:0.0:1789048638.943378:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789048638.943382:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111423872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.943402:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111423872:12345-0@lo:400:kworker.0 Request processed in 20us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048638.943406:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789048638.943412:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789048638.943416:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111424384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.943429:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111424384:12345-0@lo:400:kworker.0 Request processed in 13us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048638.943432:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789048638.943437:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789048638.943440:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111423488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.943452:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111423488:12345-0@lo:400:kworker.0 Request processed in 12us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048638.943456:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789048638.943461:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789048638.943469:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111423232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.943490:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111423232:12345-0@lo:400:kworker.0 Request processed in 21us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048638.943494:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789048638.943508:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111423232:0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.943518:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789048638.943522:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875953111423744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.943540:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875953111423744:12345-0@lo:400:kworker.0 Request processed in 18us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048638.943543:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789048638.943554:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875953111423744:0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.943564:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789048638.943568:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111424256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048638.943586:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111424256:12345-0@lo:400:kworker.0 Request processed in 18us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048638.943589:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789048638.943601:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111424256:0@lo:400:kworker.0 00000100:00100000:2.0:1789048638.944150:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111423488:0@lo:400:kworker.0 00000100:00100000:2.0:1789048638.944162:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111424000:0@lo:400:kworker.0 00000100:00100000:2.0:1789048638.944171:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111424512:0@lo:400:kworker.0 00010000:00080000:2.0:1789048638.944183:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080d8380 x1875953111423872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048638.944193:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111423872:0@lo:400:kworker.0 00010000:00080000:2.0:1789048638.944203:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080d9180 x1875953111424384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048638.944211:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111424384:0@lo:400:kworker.0 00000100:00100000:3.0:1789048638.944418:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789048638.944428:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111424640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048638.944464:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048638.944495:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111424640 00000100:00100000:3.0:1789048638.944499:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111424640 00000100:00100000:3.0:1789048638.944524:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789048638.944529:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111424640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789048638.944541:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:3.0:1789048638.944564:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111424640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048638.944568:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:3.0:1789048638.944584:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048638.944593:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789048638.944595:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789048638.944597:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789048638.944616:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111424640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789048638.944748:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789048638.944756:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08a04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111424768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048638.944791:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048638.944853:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111424768 00000100:00100000:1.0:1789048638.944857:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111424768 00000100:00100000:1.0:1789048638.944889:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789048638.944896:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875953111424768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789048638.944906:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:1.0:1789048638.944941:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875953111424768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048638.944947:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789048638.944978:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08a04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111424768:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1789048639.009609:0:13779:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789048639.009618:0:13779:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789048639.009648:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1789048639.009657:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789048639.009843:0:13779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08a04e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13779:1875953111424896:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789048639.009942:0:13779:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b080bc540 going to sleep for 11 seconds 00000100:00100000:2.0:1789048639.013086:0:13779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08a04e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13779:1875953111424896:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789048639.015151:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048639.015263:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097741440 00000100:00100000:0.0:1789048639.015276:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097741440 00000100:00100000:0.0:1789048639.015393:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 231 00000100:00100000:0.0:1789048639.015406:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+69:12465:x1875953097741440:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789048639.015441:0:12131:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789048639.015543:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+69:12465:x1875953097741440:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 142us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048639.015566:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 231 00000100:00080000:3.0:1789048639.015729:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789048639.020076:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048639.020179:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097741568 00000100:00100000:2.0:1789048639.020191:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097741568 00000100:00100000:2.0:1789048639.020265:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 232 00000100:00100000:2.0:1789048639.020277:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+69:12465:x1875953097741568:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789048639.020399:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776d89 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020438:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776d89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020452:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776d89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020470:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c08776d90 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020477:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c08776d90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020483:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c08776d90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020513:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c08776d97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020523:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c08776d97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020529:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c08776d97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048639.020595:0:6499:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789048639.020602:0:6499:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789048639.020622:0:6499:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c08776d97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020636:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776d89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020655:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776d89 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020662:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776d89 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020669:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048639.020674:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776d89 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020682:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776d89 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020696:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff959c05322a00) 00010000:00010000:2.0:1789048639.020700:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048639.020705:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776d89 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020712:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1600/0x133f221c08776d89 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020729:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c08776d90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020734:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c08776d90 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020740:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c08776d90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020744:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048639.020753:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c08776d90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020760:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c08776d90 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020768:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff959c4152a700) 00010000:00010000:2.0:1789048639.020771:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048639.020785:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c08776d90 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020792:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0200/0x133f221c08776d90 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020822:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c08776d97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020828:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c08776d97 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020834:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c08776d97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020839:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048639.020842:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c08776d97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020848:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c08776d97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020856:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:2.0:1789048639.020859:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048639.020868:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c08776d97 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.020873:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0400/0x133f221c08776d97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048639.020947:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+69:12465:x1875953097741568:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 Request processed in 671us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048639.020955:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 232 00000100:00100000:1.0:1789048639.025313:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048639.025684:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097741824 00000100:00100000:3.0:1789048639.025696:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097741824 00000100:00100000:3.0:1789048639.025764:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 233 00000100:00100000:3.0:1789048639.025785:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+69:12465:x1875953097741824:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789048639.025820:0:8649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048639.025844:0:8649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776d9e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a5f expref: -99 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.025955:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776da5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.025971:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776da5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.025983:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776da5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048639.025993:0:8649:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789048639.026060:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776da5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.026068:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776da5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.026075:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776da5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.026098:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048639.026103:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776da5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.026112:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776da5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.026126:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:3.0:1789048639.026129:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789048639.026135:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776da5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.026141:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776da5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.026187:0:8649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776d9e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a5f expref: 71 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.026198:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff959c05322a00) 00010000:00010000:3.0:1789048639.026200:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789048639.026204:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776d9e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a5f expref: 71 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.026214:0:8649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3c000, rc 0) 00000100:00100000:3.0:1789048639.026273:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+70:12465:x1875953097741824:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 500us (971us total) trans 4294967513 rc 301/301 00000100:00100000:3.0:1789048639.026279:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 233 00000100:00100000:1.0:1789048639.031195:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048639.031715:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097741952 00000100:00100000:2.0:1789048639.031726:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097741952 00000100:00100000:2.0:1789048639.032051:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 234 00000100:00100000:2.0:1789048639.032062:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+70:12465:x1875953097741952:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789048639.032098:0:6497:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789048639.032221:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+70:12465:x1875953097741952:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 160us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048639.032229:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 234 00000100:00100000:1.0:1789048639.049480:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048639.049961:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097742208 00000100:00100000:3.0:1789048639.049991:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097742208 00000100:00100000:3.0:1789048639.050064:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 235 00000100:00100000:3.0:1789048639.050076:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+70:12465:x1875953097742208:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789048639.050098:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048639.050101:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789048639.050130:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365000/0x133f221c08776d43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a43 expref: 70 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.050151:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:3.0:1789048639.050156:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789048639.050172:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776db3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a66 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789048639.050618:0:6498:0:(osp_object.c:1667:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:3.0:1789048639.051005:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776dba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.051023:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776dba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.051035:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776dba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.051091:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776db3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a66 expref: 72 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.051109:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776dba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a66 expref: 71 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.051136:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff959b06bfcd00) 00010000:00010000:3.0:1789048639.051139:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789048639.051142:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3c400, rc 0) 00000100:00100000:3.0:1789048639.051228:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+71:12465:x1875953097742208:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 1153us (1758us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1789048639.051236:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 235 00000100:00100000:1.0:1789048639.061076:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048639.061322:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097742464 00000100:00100000:0.0:1789048639.061372:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097742464 00000100:00100000:0.0:1789048639.061442:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 236 00000100:00100000:0.0:1789048639.061453:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+71:12465:x1875953097742464:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789048639.061510:0:12131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048639.061538:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776dba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a66 expref: 71 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.061558:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff959b06bfcd00) 00010000:00010000:0.0:1789048639.061569:0:12131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789048639.061591:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364800/0x133f221c08776dc8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.061617:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364800/0x133f221c08776dc8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.061627:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364800/0x133f221c08776dc8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.061641:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365600/0x133f221c08776dcf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xbdfb3584 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.061648:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365600/0x133f221c08776dcf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbdfb3584 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.061654:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365600/0x133f221c08776dcf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbdfb3584 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.061724:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364800/0x133f221c08776dc8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.061733:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364800/0x133f221c08776dc8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.061740:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364800/0x133f221c08776dc8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.061745:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08364800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048639.061750:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364800/0x133f221c08776dc8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.061757:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364800/0x133f221c08776dc8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.061765:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:0.0:1789048639.061768:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048639.061772:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364800/0x133f221c08776dc8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.061787:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364800/0x133f221c08776dc8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.061797:0:12131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365600/0x133f221c08776dcf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbdfb3584 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.061802:0:12131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365600/0x133f221c08776dcf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbdfb3584 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.061808:0:12131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365600/0x133f221c08776dcf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbdfb3584 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.061819:0:12131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08365600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048639.062257:0:12131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365600/0x133f221c08776dcf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbdfb3584 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.062268:0:12131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365600/0x133f221c08776dcf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbdfb3584 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.062277:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xbdfb3584 (ffff959c3ef1e600) 00010000:00010000:0.0:1789048639.062328:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048639.062510:0:12131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365600/0x133f221c08776dcf lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xbdfb3584 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.062520:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365600/0x133f221c08776dcf lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xbdfb3584 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048639.062660:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+70:12465:x1875953097742464:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 1208us (1596us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789048639.062668:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 236 00000100:00100000:2.0:1789048639.067094:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048639.067194:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097742592 00000100:00100000:0.0:1789048639.067205:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097742592 00000100:00100000:0.0:1789048639.067262:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 237 00000100:00100000:0.0:1789048639.067272:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+70:12465:x1875953097742592:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789048639.067298:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048639.067321:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365400/0x133f221c08776dd6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a6d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.067384:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08776ddd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.067411:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08776ddd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.067423:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08776ddd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.067526:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365400/0x133f221c08776dd6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a6d expref: 72 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.067546:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08776ddd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a6d expref: 71 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.067556:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff959c3ef1ef00) 00010000:00010000:0.0:1789048639.067558:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789048639.067562:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08365e00, rc 0) 00000100:00100000:0.0:1789048639.067625:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+71:12465:x1875953097742592:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 354us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048639.067631:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 237 00000100:00100000:3.0:1789048639.074047:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048639.074209:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097742848 00000100:00100000:0.0:1789048639.074220:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097742848 00000100:00100000:0.0:1789048639.074291:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 238 00000100:00100000:0.0:1789048639.074302:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+71:12465:x1875953097742848:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789048639.074409:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c08776de4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.074426:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c08776de4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.074456:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c08776de4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789048639.074633:0:8649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:0.0:1789048639.074965:0:8649:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000003e05ba8e reply state 000000002b3fe75d transno 4294967515 ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c08776de4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.074980:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c08776de4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.074987:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff959c3ef1ef00) 00010000:00010000:0.0:1789048639.074990:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789048639.074993:0:8649:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789048639.075113:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+73:12465:x1875953097742848:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 802us (1067us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1789048639.075122:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 238 00000100:00100000:3.0:1789048639.080898:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048639.081306:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097742976 00000100:00100000:0.0:1789048639.081317:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097742976 00000100:00100000:0.0:1789048639.081386:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 239 00000100:00100000:0.0:1789048639.081397:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+73:12465:x1875953097742976:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789048639.081423:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048639.081446:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365c00/0x133f221c08776deb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a74 expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.081504:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365c00/0x133f221c08776deb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a74 expref: 74 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.081519:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365c00/0x133f221c08776deb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a74 expref: 74 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.081552:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff959c3ef1ef00) 00010000:00010000:0.0:1789048639.081555:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789048639.081559:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08365c00, rc 0) 00000100:00100000:0.0:1789048639.081939:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+74:12465:x1875953097742976:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 543us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048639.081947:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 239 00000100:00100000:3.0:1789048639.088441:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048639.088523:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097743104 00000100:00100000:0.0:1789048639.088532:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097743104 00000100:00100000:0.0:1789048639.088589:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:0.0:1789048639.088597:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:2393:x1875953097743104:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789048639.088806:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+10:2393:x1875953097743104:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 208us (376us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789048639.088814:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00080000:3.0:1789048639.089552:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789048639.091504:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048639.091539:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097743360 00000100:00100000:3.0:1789048639.091547:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097743360 00000100:00100000:3.0:1789048639.091593:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:3.0:1789048639.091673:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+74:12465:x1875953097743360:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789048639.092257:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+75:12465:x1875953097743360:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 653us (758us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1789048639.092266:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:0.0:1789048639.099273:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048639.099377:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097743616 00000100:00100000:3.0:1789048639.099386:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097743616 00000100:00100000:3.0:1789048639.099445:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 240 00000100:00100000:3.0:1789048639.099456:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+75:12465:x1875953097743616:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789048639.099627:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+75:12465:x1875953097743616:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 172us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048639.099651:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 240 00000100:00100000:3.0:1789048639.112084:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048639.112481:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097743744 00000100:00100000:2.0:1789048639.112492:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097743744 00000100:00100000:2.0:1789048639.112537:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 241 00000100:00100000:2.0:1789048639.112546:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+75:12465:x1875953097743744:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789048639.112564:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048639.112583:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776df2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a7b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.112651:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776df9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.112682:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776df9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.112696:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776df9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048639.112748:0:6499:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789048639.112772:0:6499:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776df9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.112814:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776df2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a7b expref: 77 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.112963:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776df9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a7b expref: 76 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.112971:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff959c3ef1ef00) 00010000:00010000:2.0:1789048639.112975:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789048639.112979:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb1800, rc 0) 00000100:00100000:2.0:1789048639.113046:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+76:12465:x1875953097743744:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 500us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048639.113053:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 241 00000100:00100000:0.0:1789048639.117554:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048639.118698:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097743872 00000100:00100000:2.0:1789048639.118712:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097743872 00000100:00100000:0.0:1789048639.118949:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:0.0:1789048639.118962:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+10:2394:x1875953097743872:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789048639.118980:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048639.119003:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077473f66/0x133f221c08776e00 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a82 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789048639.119032:0:8413:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fa424e42b900, blocks: 0x0 00010000:00010000:0.0:1789048639.119057:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1789048639.119063:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048639.119089:0:8413:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077473f66/0x133f221c08776e00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a82 expref: 11 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.119119:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000077473f66/0x133f221c08776e00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a82 expref: 11 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.119135:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08364800, rc 0) 00000100:00100000:0.0:1789048639.119255:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+11:2394:x1875953097743872:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 295us (1711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048639.119263:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:3.0:1789048639.121908:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048639.122024:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097744128 00000100:00100000:1.0:1789048639.122033:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097744128 00000100:00100000:1.0:1789048639.122091:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 242 00000100:00100000:1.0:1789048639.122101:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+76:12465:x1875953097744128:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789048639.122289:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+76:12465:x1875953097744128:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 188us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048639.122296:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 242 00000100:00100000:1.0:1789048639.127930:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048639.128065:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097744256 00000100:00100000:0.0:1789048639.128076:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097744256 00000100:00100000:0.0:1789048639.128287:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 72 00000100:00100000:0.0:1789048639.128297:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+11:12465:x1875953097744256:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789048639.128315:0:8804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048639.128371:0:8804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002be18a2f/0x133f221c08776e07 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a89 expref: -99 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.128421:0:8804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000077473f66/0x133f221c08776e00 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a82 expref: 12 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.128431:0:8804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048639.128435:0:8804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048639.128440:0:8804:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002be18a2f/0x133f221c08776e07 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a89 expref: 12 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.128472:0:8804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000077473f66/0x133f221c08776e00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a82 expref: 12 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.128498:0:8804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000077473f66/0x133f221c08776e00 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a82 expref: 12 pid: 8413 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048639.128512:0:8804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08887480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8804:1875953111425024:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789048639.128608:0:8804:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0793a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048639.131799:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048639.131915:0:8804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08887480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8804:1875953111425024:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048639.131950:0:8804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002be18a2f/0x133f221c08776e07 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a89 expref: 12 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.131971:0:8804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08364c00, rc 0) 00000100:00100000:0.0:1789048639.132031:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+12:12465:x1875953097744256:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 3735us (4112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048639.132045:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 72 00000100:00100000:1.0:1789048639.132517:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097744384 00000100:00100000:1.0:1789048639.132526:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097744384 00010000:00010000:1.0:1789048639.132561:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000077473f66/0x133f221c08776e00 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a82 expref: 12 pid: 8413 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048639.132595:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 102 00000100:00100000:1.0:1789048639.132603:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+12:2393:x1875953097744384:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048639.132616:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048639.132636:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000077473f66/0x133f221c08776e00 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a82 expref: 12 pid: 8413 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.132666:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000077473f66/0x133f221c08776e00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a82 expref: 12 pid: 8413 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.132688:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077473f66/0x133f221c08776e00 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a82 expref: 12 pid: 8413 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.132701:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048639.132705:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048639.132712:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002be18a2f/0x133f221c08776e07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a89 expref: 11 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.132722:0:6483:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002be18a2f/0x133f221c08776e07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a89 expref: 11 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.132751:0:6483:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002be18a2f/0x133f221c08776e07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a89 expref: 11 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048639.132763:0:6483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6483:1875953111425152:192.168.202.16@tcp:105: 00000100:00100000:1.0:1789048639.132844:0:6483:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b080bc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048639.137597:0:6483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6483:1875953111425152:192.168.202.16@tcp:105: 00010000:00010000:1.0:1789048639.137622:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048639.137675:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+11:2393:x1875953097744384:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5072us (5886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048639.137687:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 102 00000100:00100000:3.0:1789048639.138383:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048639.138472:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097744512 00000100:00100000:2.0:1789048639.138480:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097744512 00002000:00100000:2.0:1789048639.138525:0:8418:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff959b05d75c00 x1875953097744512/t0(0) o4->85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp:650/0 lens 504/0 e 0 to 0 dl 1789048650 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789048639.138551:0:8418:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b05d75c00 with x1875953097744512 ext(0->12) 00002000:00010000:2.0:1789048639.138556:0:8418:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff959b05d75c00 00000100:00100000:2.0:1789048639.138585:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:2.0:1789048639.138594:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+11:2392:x1875953097744512:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789048639.140232:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+13:2392:x1875953097744512:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 Request processed in 1629us (1842us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789048639.140245:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00002000:00100000:2.0:1789048639.140257:0:8418:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff959b05d75c00 x1875953097744512/t4294967321(0) o4->85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp:650/0 lens 504/448 e 0 to 0 dl 1789048650 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789048639.140267:0:8418:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b05d75c00 with x1875953097744512 ext(0->12) 00002000:00010000:2.0:1789048639.140273:0:8418:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff959b05d75c00 00000100:00100000:0.0:1789048639.147026:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048639.147184:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097744640 00000100:00100000:3.0:1789048639.147195:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097744640 00000100:00100000:3.0:1789048639.147296:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 243 00000100:00100000:3.0:1789048639.147307:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+76:12465:x1875953097744640:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789048639.149065:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000004:00080000:2.0:1789048639.149113:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00010000:00010000:3.0:1789048639.149209:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776b0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149223:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776b0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149231:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776b0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149237:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048639.149242:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776b0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149250:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776b0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149269:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff959c3ef4a600) 00010000:00010000:3.0:1789048639.149272:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048639.149277:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776b0c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149299:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08776b0c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149372:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776bb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149379:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776bb4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149384:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776bb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149389:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048639.149392:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776bb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149397:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776bb4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149405:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff959b06bfc400) 00010000:00010000:3.0:1789048639.149407:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048639.149410:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776bb4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149414:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c08776bb4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149429:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c32 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149435:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c32 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149446:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c32 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149451:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048639.149454:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c32 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149459:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c32 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149466:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959c4151ab00) 00010000:00010000:3.0:1789048639.149468:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048639.149472:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c32 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149477:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08776c32 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149489:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776c55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149495:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776c55 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149502:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776c55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149507:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048639.149510:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776c55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149524:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776c55 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149531:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959c4151ab00) 00010000:00010000:3.0:1789048639.149533:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048639.149536:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776c55 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149542:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38200/0x133f221c08776c55 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149556:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776d27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149560:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776d27 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149565:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776d27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149569:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048639.149572:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776d27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149577:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776d27 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149585:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:3.0:1789048639.149587:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048639.149590:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776d27 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149604:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1e00/0x133f221c08776d27 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149616:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c08776de4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149622:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c08776de4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149627:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c08776de4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149631:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08364600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048639.149634:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c08776de4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149639:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c08776de4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149647:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff959c3ef1ef00) 00010000:00010000:3.0:1789048639.149649:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789048639.149652:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c08776de4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.149657:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c08776de4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048639.150156:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789048639.150174:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111425280:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789048639.150248:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048639.150359:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111425280 00000100:00100000:1.0:1789048639.150368:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111425280 00000100:00100000:1.0:1789048639.150425:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789048639.150435:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111425280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789048639.150463:0:8412:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:1.0:1789048639.150493:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x18d3fa421a15fd63, atime: 0x18d3fa422460a727, ctime: 0x18d3fa421a15fd63, blocks: 0x8 00010000:00010000:1.0:1789048639.150499:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f5365b0/0x133f221c08776e0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.150515:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1789048639.150519:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048639.150526:0:8412:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f5365b0/0x133f221c08776e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.150541:0:8412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f5365b0/0x133f221c08776e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.150549:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f5365b0/0x133f221c08776e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.150557:0:8412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f5365b0/0x133f221c08776e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.150573:0:8412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789048639.150712:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3621:x1875953111425280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 279us (463us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789048639.150720:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:1.0:1789048639.150755:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048639.150761:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f5365b0/0x133f221c08776e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.150768:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0000 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048639.150771:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f5365b0/0x133f221c08776e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.150792:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f5365b0/0x133f221c08776e0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.150806:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f5365b0/0x133f221c08776e0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.150813:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f5365b0/0x133f221c08776e0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789048639.150947:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff959c3fb9f800/2, rc 0, transno 4294967311 00000100:00100000:0.0:1789048639.150953:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111425280:0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1789048639.151215:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff959c034fdc00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1789048639.151220:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff959c2f243900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff959c034fd840 00000020:00080000:2.0:1789048639.151224:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff959c2f243a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff959b07abf400 00000004:00080000:2.0:1789048639.151262:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1789048639.151299:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff959c32f3ea80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1789048639.151302:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff959c2b643000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff959b07b08d80 00000020:00080000:2.0:1789048639.151305:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff959c2b643a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff959b069ba400 00000020:00080000:2.0:1789048639.151318:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:1.0:1789048639.151392:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048639.151395:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048639.151397:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789048639.151435:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789048639.151493:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789048639.151677:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789048639.151688:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111425408:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789048639.151728:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048639.151805:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111425408 00000100:00100000:2.0:1789048639.151819:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111425408 00000100:00100000:2.0:1789048639.151894:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789048639.151902:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1875953111425408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789048639.151922:0:8414:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1789048639.151942:0:8414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008285468e/0x133f221c08776e15 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.151960:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08776bc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299e1 expref: 12 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.151969:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789048639.151973:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789048639.151978:0:8414:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008285468e/0x133f221c08776e15 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.152001:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08776bc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.16@tcp remote: 0xd796648991b299e1 expref: 12 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.152014:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08776bc2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.16@tcp remote: 0xd796648991b299e1 expref: 12 pid: 8413 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048639.152026:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08842300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1875953111425536:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789048639.152078:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3e240 going to sleep for 11 seconds 00000100:00100000:2.0:1789048639.154556:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+22:12465:x1875953097744640:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 Request processed in 7242us (7531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048639.154569:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 243 00000100:00100000:2.0:1789048639.158880:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08842300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1875953111425536:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789048639.158914:0:8414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008285468e/0x133f221c08776e15 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048639.159613:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048639.159736:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048639.160257:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097744768 00000100:00100000:0.0:1789048639.160265:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097744768 00010000:00010000:0.0:1789048639.160321:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08776bc2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.16@tcp remote: 0xd796648991b299e1 expref: 13 pid: 8413 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048639.160575:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 103 00000100:00100000:2.0:1789048639.160588:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+13:2394:x1875953097744768:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048639.160603:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048639.160610:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08776bc2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.16@tcp remote: 0xd796648991b299e1 expref: 13 pid: 8413 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.160623:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08776bc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.16@tcp remote: 0xd796648991b299e1 expref: 13 pid: 8413 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.160647:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08776bc2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.16@tcp remote: 0xd796648991b299e1 expref: 13 pid: 8413 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.160664:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789048639.160669:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789048639.160674:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008285468e/0x133f221c08776e15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.160684:0:6482:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008285468e/0x133f221c08776e15 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.160720:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048639.160790:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+12:2394:x1875953097744768:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 205us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048639.160798:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 103 00010000:00010000:0.0:1789048639.160920:0:8414:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008285468e/0x133f221c08776e15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.160931:0:8414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008285468e/0x133f221c08776e15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.160942:0:8414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008285468e/0x133f221c08776e15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.160950:0:8414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008285468e/0x133f221c08776e15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.160975:0:8414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789048639.161193:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3620:x1875953111425408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9291us (9463us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789048639.161202:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789048639.161219:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097744896 00000100:00100000:0.0:1789048639.161224:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097744896 00010000:00010000:2.0:1789048639.161354:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048639.161361:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008285468e/0x133f221c08776e15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.161370:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0800 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048639.161374:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008285468e/0x133f221c08776e15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.161383:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008285468e/0x133f221c08776e15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.161397:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008285468e/0x133f221c08776e15 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.161404:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008285468e/0x133f221c08776e15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.161422:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048639.161424:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048639.161426:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048639.161655:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 75 00000100:00100000:3.0:1789048639.161666:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+12:2392:x1875953097744896:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1789048639.164135:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff959b08840a80/2, rc 0, transno 4294967322 00000100:00100000:1.0:1789048639.164212:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111425408:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1789048639.165072:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:1.0:1789048639.165083:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1789048639.165353:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2392:x1875953097744896:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 Request processed in 3666us (5593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048639.165365:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 75 00000100:00100000:1.0:1789048639.168757:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048639.168851:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097745152 00000100:00100000:2.0:1789048639.168871:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097745152 00000100:00100000:2.0:1789048639.168926:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 244 00000100:00100000:2.0:1789048639.168936:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+22:12465:x1875953097745152:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789048639.168989:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048639.169020:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776df9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a7b expref: 22 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.169052:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff959c3ef1ef00) 00010000:00010000:2.0:1789048639.169057:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789048639.169087:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776e1c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.169100:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776e1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.169117:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776e1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789048639.169233:0:6499:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000f23fb3a3 reply state 000000001b1c35e6 transno 4294967517 ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776e1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.169246:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776e1c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.169252:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff959c3ef1ef00) 00010000:00010000:2.0:1789048639.169255:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789048639.169258:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789048639.169533:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+23:12465:x1875953097745152:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 598us (783us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789048639.169541:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 244 00000100:00100000:1.0:1789048639.173908:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048639.174035:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097745280 00000100:00100000:0.0:1789048639.174046:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097745280 00000100:00100000:0.0:1789048639.174197:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 76 00000100:00100000:0.0:1789048639.174210:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2391:x1875953097745280:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789048639.174414:0:8804:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789048639.174418:0:8804:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789048639296000000 00002000:00010000:0.0:1789048639.174434:0:8804:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789048638980000000 00002000:00010000:0.0:1789048639.174437:0:8804:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789048639684000000 -> 1789048639296000000 00002000:00010000:0.0:1789048639.174439:0:8804:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789048639.174551:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2391:x1875953097745280:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 343us (654us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789048639.174560:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 76 00000100:00100000:2.0:1789048639.177689:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048639.178202:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097745536 00000100:00100000:1.0:1789048639.178213:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097745536 00000100:00100000:1.0:1789048639.178367:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 245 00000100:00100000:1.0:1789048639.178380:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+23:12465:x1875953097745536:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789048639.178558:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776e23 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.178577:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08776ddd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a6d expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.178588:0:6497:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776e23 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.178623:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08776ddd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a6d expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.178639:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08776ddd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a6d expref: 23 pid: 6497 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048639.178654:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875953111425664:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789048639.178739:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b080bc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048639.184548:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048639.185198:0:13167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097745664 00000100:00100000:2.0:1789048639.185208:0:13167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097745664 00010000:00010000:2.0:1789048639.185247:0:13167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08776ddd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a6d expref: 24 pid: 6497 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048639.185293:0:13167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 104 00000100:00100000:2.0:1789048639.185305:0:13167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+24:2393:x1875953097745664:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048639.185322:0:13167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048639.185329:0:13167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08776ddd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a6d expref: 24 pid: 6497 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.185369:0:13167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08776ddd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a6d expref: 24 pid: 6497 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.185390:0:13167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff959c3ef1ef00) 00010000:00010000:2.0:1789048639.185396:0:13167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776e23 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.185407:0:13167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776e23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.185415:0:13167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776e23 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.185435:0:13167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048639.185487:0:13167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+24:2393:x1875953097745664:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 184us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048639.185494:0:13167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 104 00010000:00010000:0.0:1789048639.186628:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08776ddd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a6d expref: 23 pid: 6497 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048639.186644:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875953111425664:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048639.186661:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776e23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.186723:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776e23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.186740:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776e23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.186790:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776e23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.186797:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776e23 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.186804:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776e23 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.186810:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048639.186814:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776e23 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.186877:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776e23 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.186890:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff959c3ef1ef00) 00010000:00010000:1.0:1789048639.186893:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789048639.186897:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776e23 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.186903:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776e23 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048639.187013:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+22:12465:x1875953097745536:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 Request processed in 8636us (9336us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789048639.187022:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 245 00000100:00100000:3.0:1789048639.189959:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048639.190039:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097745792 00000100:00100000:0.0:1789048639.190049:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097745792 00000100:00100000:0.0:1789048639.190116:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 77 00000100:00100000:0.0:1789048639.190126:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2392:x1875953097745792:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789048639.190164:0:8414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006868f2d8/0x133f221c08776e2a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.190183:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002be18a2f/0x133f221c08776e07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a89 expref: 8 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.190193:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048639.190197:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789048639.190202:0:8414:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006868f2d8/0x133f221c08776e2a lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.190253:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002be18a2f/0x133f221c08776e07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a89 expref: 8 pid: 8804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.190268:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002be18a2f/0x133f221c08776e07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a89 expref: 8 pid: 8804 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048639.190283:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08887800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1875953111425792:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789048639.190650:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0793a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048639.192627:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08887800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1875953111425792:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048639.192657:0:8414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006868f2d8/0x133f221c08776e2a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048639.194383:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048639.194419:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097745920 00000100:00100000:0.0:1789048639.194427:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097745920 00010000:00010000:0.0:1789048639.194460:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002be18a2f/0x133f221c08776e07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a89 expref: 9 pid: 8804 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048639.194493:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 105 00000100:00100000:0.0:1789048639.194500:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08840380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+9:2394:x1875953097745920:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048639.194510:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048639.194526:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002be18a2f/0x133f221c08776e07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a89 expref: 9 pid: 8804 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.194535:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002be18a2f/0x133f221c08776e07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a89 expref: 9 pid: 8804 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.194564:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002be18a2f/0x133f221c08776e07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a89 expref: 9 pid: 8804 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.194576:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789048639.194580:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789048639.194584:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006868f2d8/0x133f221c08776e2a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.194590:0:6482:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006868f2d8/0x133f221c08776e2a lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.194612:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789048639.194642:0:8414:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006868f2d8/0x133f221c08776e2a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.194652:0:8414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006868f2d8/0x133f221c08776e2a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048639.194657:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08840380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2394:x1875953097745920:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 157us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048639.194663:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 105 00010000:00010000:2.0:1789048639.194671:0:8414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006868f2d8/0x133f221c08776e2a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.194680:0:8414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006868f2d8/0x133f221c08776e2a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.194688:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006868f2d8/0x133f221c08776e2a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.194695:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08365800 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048639.194700:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006868f2d8/0x133f221c08776e2a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.194709:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006868f2d8/0x133f221c08776e2a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.194720:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006868f2d8/0x133f221c08776e2a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.194727:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006868f2d8/0x133f221c08776e2a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048639.194794:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2392:x1875953097745792:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 Request processed in 4669us (4845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048639.194946:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 77 00000100:00100000:3.0:1789048639.197653:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048639.197699:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097746176 00000100:00100000:2.0:1789048639.197709:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097746176 00000100:00100000:2.0:1789048639.197770:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 246 00000100:00100000:2.0:1789048639.197794:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+22:12465:x1875953097746176:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789048639.198155:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776e31 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.198174:0:8649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776d20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a35 expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.198183:0:8649:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776e31 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.198214:0:8649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776d20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a35 expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.198225:0:8649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776d20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a35 expref: 22 pid: 6498 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048639.198236:0:8649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08841880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8649:1875953111425920:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789048639.198304:0:8649:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3e780 going to sleep for 11 seconds 00000100:00100000:1.0:1789048639.200355:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048639.200378:0:8649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08841880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8649:1875953111425920:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789048639.200419:0:8649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776e31 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048639.200482:0:13167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097746304 00000100:00100000:3.0:1789048639.200490:0:13167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097746304 00010000:00010000:3.0:1789048639.200533:0:13167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776d20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a35 expref: 23 pid: 6498 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048639.200572:0:13167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 106 00000100:00100000:3.0:1789048639.200581:0:13167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+23:2393:x1875953097746304:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048639.200595:0:13167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048639.200603:0:13167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776d20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a35 expref: 23 pid: 6498 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.200614:0:13167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776d20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a35 expref: 23 pid: 6498 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.200636:0:13167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776d20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a35 expref: 23 pid: 6498 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.200652:0:13167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:3.0:1789048639.200656:0:13167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c08776d82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a58 expref: 22 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.200663:0:13167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776e31 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.200668:0:13167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776e31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.200673:0:13167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776e31 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.200724:0:13167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048639.200765:0:13167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+22:2393:x1875953097746304:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 185us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048639.200784:0:13167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 106 00010000:00010000:2.0:1789048639.201152:0:8649:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776e31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.201161:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776e31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.201330:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776e38 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.201377:0:8649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365c00/0x133f221c08776deb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a74 expref: 22 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.201386:0:8649:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776e38 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.201417:0:8649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365c00/0x133f221c08776deb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a74 expref: 22 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.201432:0:8649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365c00/0x133f221c08776deb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a74 expref: 22 pid: 12131 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048639.201445:0:8649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08841880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8649:1875953111426048:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789048639.201510:0:8649:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048639.203876:0:8649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08841880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8649:1875953111426048:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789048639.203885:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:2.0:1789048639.203906:0:8649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776e38 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048639.203977:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097746432 00000100:00100000:0.0:1789048639.203984:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097746432 00010000:00010000:0.0:1789048639.204014:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365c00/0x133f221c08776deb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a74 expref: 23 pid: 12131 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048639.204170:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 107 00000100:00100000:0.0:1789048639.204178:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+23:2393:x1875953097746432:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048639.204191:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048639.204196:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365c00/0x133f221c08776deb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a74 expref: 23 pid: 12131 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.204215:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365c00/0x133f221c08776deb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a74 expref: 23 pid: 12131 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.204232:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365c00/0x133f221c08776deb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a74 expref: 23 pid: 12131 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.204244:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff959c3ef1ef00) 00010000:00010000:0.0:1789048639.204248:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776e38 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.204255:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776e38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.204261:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776e38 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.204280:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789048639.204307:0:8649:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776e38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.204315:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776e38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048639.204363:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+22:2393:x1875953097746432:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 184us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048639.204370:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 107 00000001:00080000:2.0:1789048639.204450:0:8649:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967518 00000001:00080000:2.0:1789048639.204566:0:8649:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967519 00000001:00080000:2.0:1789048639.204602:0:8649:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967520 00000100:00100000:2.0:1789048639.204678:0:8649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08841880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8649:1875953111426176:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789048639.204721:0:8649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048639.204750:0:8649:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3e600 going to sleep for 11 seconds 00000100:00100000:3.0:1789048639.204769:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111426176 00000100:00100000:3.0:1789048639.204783:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111426176 00000100:00100000:3.0:1789048639.204813:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789048639.204828:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8649:x1875953111426176:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789048639.204900:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8649:x1875953111426176:12345-0@lo:1000:mdt00_003.0 Request processed in 80us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048639.204906:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789048639.204922:0:8649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1789048639.204929:0:8649:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1789048639.204962:0:8649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff959b08840a80, transno 4294967322 00000100:00100000:2.0:1789048639.205021:0:8649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08841880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8649:1875953111426176:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789048639.205116:0:8649:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967521 00000100:00100000:2.0:1789048639.205152:0:8649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08841880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8649:1875953111426304:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789048639.205178:0:8649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048639.205202:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111426304 00000100:00100000:2.0:1789048639.205205:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111426304 00000100:00100000:2.0:1789048639.205228:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789048639.205235:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8649:x1875953111426304:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789048639.205322:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8649:x1875953111426304:12345-0@lo:1000:mdt00_003.0 Request processed in 87us (142us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789048639.205328:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789048639.205369:0:8649:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3e780 going to sleep for 11 seconds 00000100:00100000:2.0:1789048639.205393:0:8649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08841880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8649:1875953111426304:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789048639.205417:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776e38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.205427:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776e38 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.205433:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776e38 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.205438:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048639.205443:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776e38 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.205451:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776e38 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.205462:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff959c3ef1ef00) 00010000:00010000:2.0:1789048639.205464:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789048639.205468:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776e38 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.205474:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0800/0x133f221c08776e38 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.205492:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776d7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.205498:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776d7b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.205503:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776d7b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.205514:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3ca00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048639.205517:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776d7b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.205522:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776d7b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.205530:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:2.0:1789048639.205532:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789048639.205538:0:8649:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c08776d82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a58 expref: 25 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.205547:0:8649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c08776d82 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a58 expref: 25 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.205556:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c08776d82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a58 expref: 25 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.205578:0:8649:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c08776d82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a58 expref: 25 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048639.205590:0:8649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08841c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8649:1875953111426432:192.168.202.16@tcp:105: 00000100:00100000:2.0:1789048639.205641:0:8649:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2b027f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789048639.209932:0:8649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08841c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8649:1875953111426432:192.168.202.16@tcp:105: 00010000:00010000:2.0:1789048639.209960:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776d7b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.209987:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776d7b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.210019:0:8649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776e3f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.210033:0:8649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776e3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.210045:0:8649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776e3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.210056:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776e3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.210063:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776e3f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.210069:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776e3f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.210074:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048639.210078:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776e3f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.210084:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776e3f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.210094:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:2.0:1789048639.210098:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048639.210114:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776e3f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.210125:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1400/0x133f221c08776e3f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.210135:0:8649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776e31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.210140:0:8649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776e31 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.210145:0:8649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776e31 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.210150:0:8649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048639.210153:0:8649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776e31 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.210160:0:8649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776e31 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.210168:0:8649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:2.0:1789048639.210170:0:8649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789048639.210172:0:8649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776e31 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.210177:0:8649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1800/0x133f221c08776e31 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048639.210324:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+25:12465:x1875953097746176:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 12532us (12676us total) trans 4294967522 rc 0/0 00000040:00080000:1.0:1789048639.210569:0:13779:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789048639.210574:0:13779:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789048639.211006:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789048639.211014:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789048639.211245:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 246 00000020:00080000:2.0:1789048639.211263:0:8649:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789048639.213537:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048639.215709:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097746560 00000100:00100000:0.0:1789048639.215723:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097746560 00000100:00100000:1.0:1789048639.216081:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:1.0:1789048639.216092:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+25:12464:x1875953097746560:12345-192.168.202.16@tcp:49:lfs.0 00000100:00100000:1.0:1789048639.216492:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+25:12464:x1875953097746560:12345-192.168.202.16@tcp:49:lfs.0 Request processed in 401us (2963us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048639.216500:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:2.0:1789048639.216687:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048639.216842:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097746816 00000100:00100000:0.0:1789048639.216848:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097746816 00000100:00100000:0.0:1789048639.216887:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:0.0:1789048639.216895:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b2a8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+25:12465:x1875953097746816:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789048639.217414:0:6501:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789048639.217457:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967523 00010000:00010000:0.0:1789048639.217488:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365c00/0x133f221c08776e46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.217503:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365c00/0x133f221c08776e46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.217514:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365c00/0x133f221c08776e46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.217523:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365c00/0x133f221c08776e46 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.217529:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365c00/0x133f221c08776e46 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.217536:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365c00/0x133f221c08776e46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048639.217549:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789048639.217613:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b2a8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+27:12465:x1875953097746816:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 717us (924us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789048639.217620:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 62 00000020:00080000:0.0:1789048639.217624:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789048639.217936:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048639.217944:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365c00/0x133f221c08776e46 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.217952:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08365c00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048639.217956:0:7447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365c00/0x133f221c08776e46 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.217964:0:7447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365c00/0x133f221c08776e46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.217979:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff959c3ef1ef00) 00010000:00010000:2.0:1789048639.217981:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789048639.217986:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365c00/0x133f221c08776e46 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.217992:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365c00/0x133f221c08776e46 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048639.218007:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048639.218009:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048639.218010:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048639.221529:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048639.221650:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097747072 00000100:00100000:0.0:1789048639.221660:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097747072 00000100:00100000:0.0:1789048639.221759:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 247 00000100:00100000:0.0:1789048639.221769:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+27:12464:x1875953097747072:12345-192.168.202.16@tcp:58:lfs.0 00000040:00080000:0.0:1789048639.221965:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1789048639.222068:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+27:12464:x1875953097747072:12345-192.168.202.16@tcp:58:lfs.0 Request processed in 300us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048639.222093:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 247 00000100:00100000:1.0:1789048639.248937:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048639.249589:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097747200 00000100:00100000:2.0:1789048639.249599:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097747200 00000100:00100000:3.0:1789048639.249708:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 248 00000100:00100000:3.0:1789048639.249719:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+27:12467:x1875953097747200:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789048639.249744:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048639.249764:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776e4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a90 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.250106:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776e54 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.250123:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776e54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.250136:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776e54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.250171:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776e5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.250179:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776e5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.250186:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776e5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.250266:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776e62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.250279:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776d6d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a51 expref: 28 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.250286:0:6497:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776e62 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.250319:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776d6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a51 expref: 28 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.250329:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776d6d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a51 expref: 28 pid: 6498 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048639.250378:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875953111426560:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048639.250520:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c42840 going to sleep for 11 seconds 00000100:00100000:1.0:1789048639.253393:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048639.253506:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097747456 00000100:00100000:3.0:1789048639.253510:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875953111426560:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789048639.253514:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097747456 00010000:00010000:3.0:1789048639.253535:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776e62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048639.253600:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:0.0:1789048639.253620:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+29:6167:x1875953097747456:12345-192.168.202.16@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789048639.253847:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+30:6167:x1875953097747456:12345-192.168.202.16@tcp:35:ldlm_bl.0 Request processed in 229us (468us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1789048639.253855:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:1.0:1789048639.257985:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048639.258109:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097747584 00000100:00100000:3.0:1789048639.258118:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097747584 00010000:00010000:3.0:1789048639.258153:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776d6d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a51 expref: 30 pid: 6498 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048639.258195:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 108 00000100:00100000:3.0:1789048639.258206:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c07cf5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+30:2393:x1875953097747584:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048639.258224:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048639.258231:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776d6d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a51 expref: 30 pid: 6498 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.258244:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776d6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a51 expref: 30 pid: 6498 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.258268:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776d6d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29a51 expref: 30 pid: 6498 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.258285:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:3.0:1789048639.258290:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776e62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.258299:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776e62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.258308:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776e62 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.258366:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776e62 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.258375:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776e62 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048639.258391:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:1.0:1789048639.258426:0:6497:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789048639.258430:0:6497:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789048639.258451:0:6497:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776e62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048639.258458:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c07cf5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+29:2393:x1875953097747584:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 254us (483us total) trans 0 rc 0/0 00010000:00010000:1.0:1789048639.258463:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776e62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048639.258466:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 108 00010000:00010000:1.0:1789048639.258473:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776e54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.258492:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776e54 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.258499:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776e54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.258504:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048639.258508:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776e54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.258516:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776e54 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.258525:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:1.0:1789048639.258528:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048639.258532:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776e54 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.258538:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08776e54 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.258548:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776e5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.258554:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776e5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.258559:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776e5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.258564:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048639.258572:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776e5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.258578:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776e5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.258585:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff959b06bfc400) 00010000:00010000:1.0:1789048639.258587:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048639.258591:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776e5b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.258596:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c400/0x133f221c08776e5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.258757:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776e4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a90 expref: 29 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.258784:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776e62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a90 expref: 28 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048639.258792:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:1.0:1789048639.258795:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789048639.258805:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3ca00, rc 0) 00000100:00100000:1.0:1789048639.258832:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+28:12467:x1875953097747200:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 9115us (9908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048639.258839:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 248 00000100:00100000:3.0:1789048639.453538:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789048639.453565:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111426688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789048639.453637:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789048639.453693:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048639.453707:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111426688 00000100:00100000:3.0:1789048639.453715:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111426688 00000100:00100000:3.0:1789048639.453761:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789048639.453782:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111426688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789048639.453832:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789048639.453879:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111426688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048639.453887:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789048639.453937:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111426688:0@lo:41:osp-pre-0-1.0 00000004:00080000:1.0:1789048639.966075:0:8801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 394719738835ns, next at 395719736025ns, rc = 0 00000100:00100000:3.0:1789048639.966621:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111426816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048639.966714:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048639.968088:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111426816 00000100:00100000:1.0:1789048639.968098:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111426816 00000100:00100000:1.0:1789048639.968175:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789048639.968188:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111426816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789048639.968210:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1789048639.968264:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111426816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048639.968268:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789048639.972048:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111426816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048639.972098:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789048639.972110:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111426944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048639.972170:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048639.984913:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111426944 00000100:00100000:0.0:1789048639.984929:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111426944 00000100:00100000:0.0:1789048639.985228:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789048639.985239:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111426944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789048639.985266:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1789048639.985381:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111426944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (13210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048639.985388:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789048639.985955:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111426944:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1789048640.163880:0:14689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789048640.163889:0:14689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789048640.163919:0:14689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789048640.163926:0:14689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789048640.232850:0:13779:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789048640.232856:0:13779:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789048640.232876:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789048640.232882:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789048640.233015:0:13779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13779:1875953111427072:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789048640.233096:0:13779:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c423c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048640.237044:0:13779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13779:1875953111427072:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789048640.250920:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048640.251017:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097747712 00000100:00100000:2.0:1789048640.251028:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097747712 00000100:00100000:2.0:1789048640.251090:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 249 00000100:00100000:2.0:1789048640.251101:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+28:12479:x1875953097747712:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789048640.251138:0:8649:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789048640.251265:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+28:12479:x1875953097747712:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 166us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048640.251273:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 249 00000100:00100000:3.0:1789048640.260266:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048640.260448:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097747968 00000100:00100000:0.0:1789048640.260458:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097747968 00000100:00100000:0.0:1789048640.260514:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 250 00000100:00100000:0.0:1789048640.260525:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+28:12479:x1875953097747968:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789048640.260549:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048640.260574:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365800/0x133f221c08776e69 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a97 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048640.260719:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08776e70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048640.260734:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08776e70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048640.260749:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08776e70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048640.260772:0:6498:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789048640.260906:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365800/0x133f221c08776e69 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a97 expref: 31 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048640.260925:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08776e70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a97 expref: 30 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048640.260934:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:0.0:1789048640.260937:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048640.260942:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08365e00, rc 0) 00000100:00100000:0.0:1789048640.261010:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+30:12479:x1875953097747968:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 487us (761us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789048640.261017:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 250 00000100:00100000:2.0:1789048640.267510:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048640.267549:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048640.267880:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097748352 00000100:00100000:3.0:1789048640.267892:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097748352 00000100:00100000:3.0:1789048640.268020:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:3.0:1789048640.268033:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+30:2394:x1875953097748352:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048640.268065:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048640.268096:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08776e70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a97 expref: 30 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048640.268117:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:3.0:1789048640.268123:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048640.268189:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+29:2394:x1875953097748352:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 149us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048640.268196:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:1.0:1789048640.268296:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097748224 00000100:00100000:1.0:1789048640.268301:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097748224 00000100:00100000:1.0:1789048640.268362:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 251 00000100:00100000:1.0:1789048640.268370:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+29:12479:x1875953097748224:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789048640.268659:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776e7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048640.268675:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776e7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048640.268687:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776e7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048640.268854:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776e7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048640.268861:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776e7e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048640.268868:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776e7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048640.268874:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048640.268878:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776e7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048640.268896:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776e7e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048640.269702:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:1.0:1789048640.269710:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789048640.269718:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776e7e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048640.269726:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1200/0x133f221c08776e7e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048640.269864:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+30:12479:x1875953097748224:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 1492us (2372us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1789048640.269873:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 251 00000040:00080000:2.0:1789048640.271388:0:13779:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789048640.271395:0:13779:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789048640.273543:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789048640.273568:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789048640.278526:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048640.279291:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097748608 00000100:00100000:3.0:1789048640.279302:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097748608 00000100:00100000:3.0:1789048640.279388:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:3.0:1789048640.279410:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+30:12479:x1875953097748608:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789048640.279659:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+31:12479:x1875953097748608:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 259us (1141us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1789048640.279678:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 64 00010000:00010000:2.0:1789048640.479218:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048640.990274:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111427200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048640.990383:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048640.990589:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111427200 00000100:00100000:3.0:1789048640.990598:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111427200 00000100:00100000:3.0:1789048640.990655:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789048640.990665:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111427200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789048640.990700:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789048640.991324:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111427200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048640.991465:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111427200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048640.991476:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00010000:00010000:0.0:1789048641.501717:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789048642.033555:0:14740:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789048642.033566:0:14740:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789048642.033597:0:14740:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789048642.033604:0:14740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789048642.255432:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048642.258388:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097748864 00000100:00100000:3.0:1789048642.258403:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097748864 00000100:00100000:3.0:1789048642.258480:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 252 00000100:00100000:3.0:1789048642.258491:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+31:12500:x1875953097748864:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789048642.258515:0:12131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048642.258539:0:12131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776e85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29a9e expref: -99 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048642.258647:0:12131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776e8c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048642.258661:0:12131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776e8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048642.258675:0:12131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776e8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048642.258687:0:12131:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789048642.258804:0:12131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776e85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a9e expref: 34 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048642.258829:0:12131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776e8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a9e expref: 33 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048642.258838:0:12131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:3.0:1789048642.258842:0:12131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789048642.258845:0:12131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3de00, rc 0) 00000100:00100000:3.0:1789048642.258909:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+33:12500:x1875953097748864:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 420us (3486us total) trans 4294967529 rc 0/0 00000100:00100000:3.0:1789048642.258916:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 252 00000100:00080000:2.0:1789048642.261553:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789048642.268884:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048642.268936:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097748992 00000100:00100000:3.0:1789048642.268946:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097748992 00000100:00100000:3.0:1789048642.269005:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 253 00000100:00100000:3.0:1789048642.269016:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+33:12500:x1875953097748992:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:3.0:1789048642.269081:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776e9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048642.269099:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776e9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048642.269110:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776e9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048642.269142:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776e9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048642.269150:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776e9a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048642.269167:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776e9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048642.269172:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048642.269176:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776e9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048642.269184:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776e9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048642.269196:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:3.0:1789048642.269200:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789048642.269204:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776e9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048642.269211:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d800/0x133f221c08776e9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048642.269282:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+33:12500:x1875953097748992:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 268us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048642.269290:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 253 00000100:00100000:1.0:1789048642.393157:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048642.393287:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097749120 00000100:00100000:2.0:1789048642.393298:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097749120 00000100:00100000:2.0:1789048642.393425:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00100000:2.0:1789048642.393436:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2392:x1875953097749120:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:2.0:1789048642.393459:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048642.393482:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000195acb85/0x133f221c08776ea1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29aa5 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789048642.393507:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x18d3fa4237225000, atime: 0x18d3fa42244c8900, ctime: 0x18d3fa4237225000, blocks: 0x8 00010000:00010000:2.0:1789048642.393528:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1789048642.393533:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048642.393542:0:8412:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000195acb85/0x133f221c08776ea1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29aa5 expref: 8 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048642.393561:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000195acb85/0x133f221c08776ea1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29aa5 expref: 8 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048642.393591:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb1800, rc 0) 00000100:00100000:2.0:1789048642.393660:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2392:x1875953097749120:12345-192.168.202.16@tcp:101:cat.0 Request processed in 225us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048642.393666:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00080000:3.0:1789048642.395060:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048642.398298:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048642.398442:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097749248 00000100:00100000:0.0:1789048642.398463:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097749248 00002000:00100000:0.0:1789048642.398516:0:8417:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff959b08840a80 x1875953097749248/t0(0) o3->85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp:653/0 lens 488/0 e 0 to 0 dl 1789048653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789048642.398528:0:8417:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b08840a80 with x1875953097749248 ext(0->4095) 00002000:00010000:0.0:1789048642.398535:0:8417:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff959b08840a80 00000100:00100000:0.0:1789048642.398574:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:0.0:1789048642.398583:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2393:x1875953097749248:12345-192.168.202.16@tcp:3:cat.0 00000100:00100000:0.0:1789048642.398775:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+8:2393:x1875953097749248:12345-192.168.202.16@tcp:3:cat.0 Request processed in 192us (486us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789048642.398782:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00002000:00100000:0.0:1789048642.398799:0:8417:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff959b08840a80 x1875953097749248/t0(0) o3->85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b@192.168.202.16@tcp:653/0 lens 488/4536 e 0 to 0 dl 1789048653 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789048642.398807:0:8417:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b08840a80 with x1875953097749248 ext(0->4095) 00002000:00010000:0.0:1789048642.398811:0:8417:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff959b08840a80 00010000:00010000:3.0:1789048642.528282:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048642.626298:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048642.626364:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048642.626404:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048642.626437:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048642.626464:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048642.626496:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097749888 00000100:00100000:1.0:1789048642.626524:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097749888 00000100:00100000:1.0:1789048642.626584:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097749504 00000100:00100000:1.0:1789048642.626588:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097749504 00000100:00100000:1.0:1789048642.626605:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097749760 00000100:00100000:1.0:1789048642.626607:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097749760 00000100:00100000:1.0:1789048642.626623:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 351 00000100:00100000:1.0:1789048642.626633:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097749888:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048642.626706:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097749888:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 74us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048642.626713:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 351 00000100:00100000:1.0:1789048642.626730:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 352 00000100:00100000:1.0:1789048642.626735:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097749504:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048642.626773:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097749504:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 37us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048642.626779:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 352 00000100:00100000:1.0:1789048642.626807:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 353 00000100:00100000:1.0:1789048642.626815:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097749760:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048642.626838:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2394:x1875953097749760:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 25us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048642.626843:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 353 00000100:00080000:1.0:1789048642.626860:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789048642.626863:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048642.626945:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097749632 00000100:00100000:3.0:1789048642.626949:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097749632 00000100:00100000:3.0:1789048642.626991:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 131 00000100:00100000:3.0:1789048642.627001:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097749632:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048642.627028:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2394:x1875953097749632:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 31us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048642.627046:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 131 00000100:00080000:1.0:1789048642.627523:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789048642.627674:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097749376 00000100:00100000:2.0:1789048642.627680:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097749376 00000100:00100000:2.0:1789048642.627721:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 402 00000100:00100000:2.0:1789048642.627728:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2394:x1875953097749376:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048642.627773:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2394:x1875953097749376:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 45us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048642.627779:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 402 00010000:00010000:3.0:1789048643.554256:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048644.062600:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111427328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789048644.062715:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048644.062834:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111427328 00000100:00100000:0.0:1789048644.062845:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111427328 00000100:00100000:0.0:1789048644.062912:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789048644.062926:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3622:x1875953111427328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789048644.062965:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048644.063018:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3622:x1875953111427328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048644.063027:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1789048644.063053:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789048644.063112:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111427328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048644.064669:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111427456:0@lo:400:kworker.0 00000100:00100000:2.0:1789048644.064764:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048644.064806:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111427968:0@lo:400:kworker.0 00000100:00100000:2.0:1789048644.064834:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048644.064855:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111428480:0@lo:400:kworker.0 00000100:00100000:2.0:1789048644.064882:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048644.064908:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789048644.064914:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111427840:0@lo:400:kworker.0 00000100:00100000:2.0:1789048644.064940:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048644.064960:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111428352:0@lo:400:kworker.0 00000100:00100000:2.0:1789048644.064979:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048644.065010:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111428864:0@lo:400:kworker.0 00000100:00100000:2.0:1789048644.065032:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048644.065065:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111427584:0@lo:400:kworker.0 00000100:00100000:2.0:1789048644.065088:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048644.065105:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111428096:0@lo:400:kworker.0 00000100:00100000:2.0:1789048644.065125:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048644.065141:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111428608:0@lo:400:kworker.0 00000100:00100000:2.0:1789048644.065164:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048644.065189:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789048644.065197:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111427712:0@lo:400:kworker.0 00000100:00100000:2.0:1789048644.065222:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048644.065241:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111428224:0@lo:400:kworker.0 00000100:00100000:2.0:1789048644.065265:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048644.065283:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111428736:0@lo:400:kworker.0 00000100:00100000:2.0:1789048644.065310:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048644.065365:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111427456 00000100:00100000:2.0:1789048644.065374:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111427456 00000100:00100000:2.0:1789048644.065425:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1789048644.065435:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3623:x1875953111427456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048644.065491:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3623:x1875953111427456:12345-0@lo:400:kworker.0 Request processed in 57us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048644.065499:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1789048644.065543:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111427968 00000100:00100000:2.0:1789048644.065548:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111427968 00000100:00100000:2.0:1789048644.065574:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111427712 00000100:00100000:2.0:1789048644.065577:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111427712 00000100:00100000:2.0:1789048644.065602:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789048644.065608:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111427968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048644.065645:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111427968:12345-0@lo:400:kworker.0 Request processed in 38us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048644.065651:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789048644.065665:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789048644.065671:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111427712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048644.065704:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111427712:12345-0@lo:400:kworker.0 Request processed in 34us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048644.065710:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789048644.065738:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111428480 00000100:00100000:2.0:1789048644.065743:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111428480 00000100:00100000:2.0:1789048644.065777:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111428352 00000100:00100000:2.0:1789048644.065781:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111428352 00000100:00100000:2.0:1789048644.065795:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111428864 00000100:00100000:2.0:1789048644.065798:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111428864 00000100:00100000:2.0:1789048644.065812:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789048644.065819:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2ecbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111428480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048644.065849:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2ecbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111428480:12345-0@lo:400:kworker.0 Request processed in 31us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048644.065855:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789048644.066097:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789048644.066104:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111428352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048644.066138:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111428352:12345-0@lo:400:kworker.0 Request processed in 35us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048644.066147:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789048644.066173:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789048644.066190:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111428864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048644.066237:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111428864:12345-0@lo:400:kworker.0 Request processed in 51us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048644.066246:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789048644.066312:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111427840 00000100:00100000:1.0:1789048644.066328:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111427840 00000100:00100000:1.0:1789048644.066602:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111427584 00000100:00100000:1.0:1789048644.066606:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111427584 00000100:00100000:1.0:1789048644.066635:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111428096 00000100:00100000:1.0:1789048644.066639:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111428096 00000100:00100000:1.0:1789048644.066654:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111428608 00000100:00100000:1.0:1789048644.066656:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111428608 00000100:00100000:1.0:1789048644.066669:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111428224 00000100:00100000:1.0:1789048644.066672:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111428224 00000100:00100000:1.0:1789048644.066683:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111428736 00000100:00100000:1.0:1789048644.066685:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111428736 00000100:00100000:1.0:1789048644.066705:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789048644.066714:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111427840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048644.066816:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111427840:12345-0@lo:400:kworker.0 Request processed in 103us (1874us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048644.066824:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789048644.066842:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789048644.066848:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111427584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048644.066877:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111427584:12345-0@lo:400:kworker.0 Request processed in 30us (1788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048644.066882:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789048644.066893:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789048644.066900:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111428096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048644.066926:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111428096:12345-0@lo:400:kworker.0 Request processed in 28us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048644.066932:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789048644.066942:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789048644.066948:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111428608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048644.066975:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111428608:12345-0@lo:400:kworker.0 Request processed in 28us (1811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048644.066990:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789048644.067003:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789048644.067008:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111428224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048644.067056:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111428224:12345-0@lo:400:kworker.0 Request processed in 47us (1789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048644.067062:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1789048644.069012:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1789048644.069037:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111428736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048644.069141:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111428736:12345-0@lo:400:kworker.0 Request processed in 114us (3830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048644.069149:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00080000:2.0:1789048644.069200:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789048644.069206:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789048644.069210:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789048644.069214:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048644.069265:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111427712:0@lo:400:kworker.0 00010000:00080000:2.0:1789048644.069285:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080d8a80 x1875953111428224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048644.069297:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111428224:0@lo:400:kworker.0 00000100:00100000:3.0:1789048644.071662:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000001:00080000:1.0:1789048644.071689:0:9492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:3.0:1789048644.071692:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111428992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048644.071793:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048644.071851:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111428992 00000100:00100000:3.0:1789048644.071860:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111428992 00000100:00100000:3.0:1789048644.071932:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789048644.071945:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111428992:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048644.071963:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111427840:0@lo:400:kworker.0 00002000:00000024:3.0:1789048644.071976:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789048644.071987:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111428352:0@lo:400:kworker.0 00000100:00100000:1.0:1789048644.072006:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111428864:0@lo:400:kworker.0 00000100:00100000:3.0:1789048644.072034:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111428992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048644.072042:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789048644.072088:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111428992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048644.072589:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3623:1875953111427456:0@lo:400:kworker.0 00000100:00100000:1.0:1789048644.072611:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111427968:0@lo:400:kworker.0 00000100:00100000:1.0:1789048644.072623:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111428480:0@lo:400:kworker.0 00010000:00080000:3.0:1789048644.073258:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080d9f80 x1875953111428736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048644.073274:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111428736:0@lo:400:kworker.0 00000100:00100000:3.0:1789048644.073291:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111427584:0@lo:400:kworker.0 00000100:00100000:3.0:1789048644.073302:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111428096:0@lo:400:kworker.0 00000100:00100000:3.0:1789048644.073314:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111428608:0@lo:400:kworker.0 00000100:00100000:2.0:1789048644.573924:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111429120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048644.574023:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048644.574303:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111429120 00000100:00100000:3.0:1789048644.574313:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111429120 00000100:00100000:3.0:1789048644.574407:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789048644.574418:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111429120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789048644.574485:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789048644.574551:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111429120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048644.574558:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789048644.574803:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111429120:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789048644.575025:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048645.086888:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111429248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048645.087233:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048645.087379:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111429248 00000100:00100000:2.0:1789048645.087389:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111429248 00000100:00100000:2.0:1789048645.087450:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789048645.087463:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111429248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789048645.087516:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789048645.087575:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111429248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048645.087584:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789048645.087658:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111429248:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1789048645.089698:0:8801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 399843360983ns, next at 400843357300ns, rc = 0 00000100:00100000:3.0:1789048645.090209:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111429376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048645.090290:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048645.090407:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111429376 00000100:00100000:0.0:1789048645.090421:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111429376 00000100:00100000:0.0:1789048645.090489:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789048645.090503:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875953111429376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789048645.090546:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789048645.090740:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875953111429376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 239us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048645.090750:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789048645.090828:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111429376:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1789048645.092030:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1789048645.092055:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1789048645.093002:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000004:00080000:1.0:1789048645.093027:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1789048645.093203:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff959c32f3e600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1789048645.093210:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff959c2f243100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff959c32f3e480 00000020:00080000:1.0:1789048645.093214:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff959c2f243f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff959b083daa00 00000020:00080000:1.0:1789048645.093237:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:3.0:1789048645.093318:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776e1c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048645.093358:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776e1c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048645.093369:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776e1c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048645.093376:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048645.093382:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776e1c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048645.093391:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776e1c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048645.093412:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff959c3ef1ef00) 00010000:00010000:3.0:1789048645.093415:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048645.093420:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776e1c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048645.093428:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1200/0x133f221c08776e1c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789048645.093617:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1789048645.093733:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1789048645.095661:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111429504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789048645.095794:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048645.095975:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111429504 00000100:00100000:3.0:1789048645.096005:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111429504 00000100:00100000:3.0:1789048645.096095:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789048645.096107:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111429504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789048645.096313:0:8412:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789048645.096317:0:8412:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1789048639296000000 -> 1789048639296000000 00002000:00010000:3.0:1789048645.096320:0:8412:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 1789048638980000000 -> 1789048638980000000 00002000:00010000:3.0:1789048645.096323:0:8412:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789048639296000000 -> 1789048639296000000 00002000:00010000:3.0:1789048645.096326:0:8412:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789048645.104478:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111429504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 8359us (8671us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1789048645.104498:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789048645.104788:0:3623:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1789048645.104797:0:3623:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1789048645.104832:0:3623:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff959b0810ad80 x1875953111429504/t4294967325(4294967325) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789048661 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789048645.104861:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff959b0810ad80/2, rc 0, transno 4294967325 00000100:00100000:1.0:1789048645.104867:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111429504:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1789048645.597969:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048646.110895:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789048646.113665:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111429632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048646.113766:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048646.113868:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111429632 00000100:00100000:2.0:1789048646.113876:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111429632 00000100:00100000:2.0:1789048646.113927:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789048646.113936:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111429632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789048646.113974:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789048646.114020:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111429632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048646.114027:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789048646.119905:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111429632:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1789048646.308610:0:13781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789048646.429563:0:13779:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789048646.429573:0:13779:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789048646.429654:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1789048646.429660:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789048646.621620:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048647.655871:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048647.754065:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048647.754162:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048647.754244:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048647.754269:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048647.754684:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097750528 00000100:00100000:0.0:1789048647.754708:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097750528 00000100:00100000:0.0:1789048647.754777:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 135 00000100:00100000:0.0:1789048647.754788:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097750528:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048647.754862:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097750528:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 76us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048647.754870:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 135 00000100:00100000:2.0:1789048647.755627:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097750016 00000100:00100000:2.0:1789048647.755636:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097750016 00000100:00100000:2.0:1789048647.755684:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 404 00000100:00100000:2.0:1789048647.755703:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2393:x1875953097750016:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048647.755747:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2393:x1875953097750016:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 57us (1693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048647.755761:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 404 00000100:00080000:2.0:1789048647.755790:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789048647.755969:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048647.756057:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097750272 00000100:00100000:1.0:1789048647.756062:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097750272 00000100:00100000:1.0:1789048647.756129:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097750784 00000100:00100000:1.0:1789048647.756142:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097750784 00000100:00080000:2.0:1789048647.756218:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048647.756394:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048647.756418:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048647.756439:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097750400 00000100:00100000:3.0:1789048647.756443:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097750400 00000100:00100000:3.0:1789048647.756477:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 136 00000100:00100000:3.0:1789048647.756488:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2393:x1875953097750400:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048647.756542:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2393:x1875953097750400:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 58us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048647.756549:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 136 00000100:00080000:3.0:1789048647.756566:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048647.756651:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097750144 00000100:00100000:2.0:1789048647.756656:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097750144 00000100:00100000:2.0:1789048647.756707:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097750656 00000100:00100000:2.0:1789048647.756711:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097750656 00000100:00100000:2.0:1789048647.756729:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 360 00000100:00100000:2.0:1789048647.756736:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097750272:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048647.756773:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2393:x1875953097750272:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 37us (2611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048647.756780:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 360 00000100:00100000:2.0:1789048647.756796:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 361 00000100:00100000:2.0:1789048647.756802:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+19:2393:x1875953097750144:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048647.756829:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+19:2393:x1875953097750144:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048647.756835:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 361 00000100:00100000:2.0:1789048647.756848:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 362 00000100:00100000:2.0:1789048647.756855:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097750656:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048647.756881:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097750656:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048647.756887:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 362 00000100:00080000:3.0:1789048647.757081:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789048647.757536:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 363 00000100:00100000:1.0:1789048647.757545:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097750784:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048647.757586:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2393:x1875953097750784:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 43us (3316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048647.757591:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 363 00000100:00100000:3.0:1789048648.195033:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048648.195147:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097750912 00000100:00100000:1.0:1789048648.195157:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097750912 00000100:00100000:1.0:1789048648.195226:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 254 00000100:00100000:1.0:1789048648.195236:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+19:12145:x1875953097750912:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789048648.195383:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+19:12145:x1875953097750912:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 Request processed in 148us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048648.195391:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 254 00000100:00100000:1.0:1789048648.200839:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048648.201038:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097751040 00000100:00100000:2.0:1789048648.201051:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097751040 00000100:00100000:2.0:1789048648.201127:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 255 00000100:00100000:2.0:1789048648.201155:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:12145:x1875953097751040:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789048648.201270:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:12145:x1875953097751040:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 Request processed in 117us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048648.201277:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 255 00000100:00100000:3.0:1789048648.203380:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048648.203698:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097751296 00000100:00100000:1.0:1789048648.203741:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097751296 00000100:00100000:1.0:1789048648.203808:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:1.0:1789048648.203818:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+19:12145:x1875953097751296:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789048648.204071:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:12145:x1875953097751296:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 253us (703us total) trans 4294967530 rc 0/0 00000100:00100000:1.0:1789048648.204079:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 65 00010000:00010000:3.0:1789048648.669564:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048649.181687:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789048649.181724:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111429760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789048649.181832:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048649.181881:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111429760 00000100:00100000:2.0:1789048649.181898:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111429760 00000100:00100000:2.0:1789048649.182001:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789048649.182015:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111429760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789048649.182054:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789048649.182165:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111429760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048649.182172:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789048649.182230:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1789048649.182237:0:3620:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1789048649.182260:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff959c3fb9f800, transno 4294967311 00000100:00100000:2.0:1789048649.182288:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111429760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048649.182493:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111430272:0@lo:400:kworker.0 00000100:00100000:2.0:1789048649.182544:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048649.182570:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111430784:0@lo:400:kworker.0 00000100:00100000:2.0:1789048649.182592:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048649.182616:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111431296:0@lo:400:kworker.0 00000100:00100000:2.0:1789048649.182637:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048649.182663:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789048649.182670:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111430144:0@lo:400:kworker.0 00000100:00100000:2.0:1789048649.182706:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048649.182745:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111430656:0@lo:400:kworker.0 00000100:00100000:2.0:1789048649.182776:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048649.182804:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111431168:0@lo:400:kworker.0 00000100:00100000:3.0:1789048649.182833:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111430272 00000100:00100000:2.0:1789048649.182834:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048649.182847:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111430272 00000100:00100000:2.0:1789048649.182889:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111430144 00000100:00100000:2.0:1789048649.182897:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111430144 00000100:00100000:3.0:1789048649.182916:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111430656 00000100:00100000:3.0:1789048649.182923:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111430656 00000100:00100000:2.0:1789048649.182948:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789048649.182965:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111430144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048649.182966:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111431168 00000100:00100000:3.0:1789048649.182975:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111431168 00000100:00100000:2.0:1789048649.183031:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111430144:12345-0@lo:400:kworker.0 Request processed in 74us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048649.183038:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789048649.183067:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1789048649.183075:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111430272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048649.183103:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111430272:12345-0@lo:400:kworker.0 Request processed in 29us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048649.183108:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1789048649.183124:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789048649.183130:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111430656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048649.183154:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111430656:12345-0@lo:400:kworker.0 Request processed in 25us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048649.183158:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789048649.183167:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789048649.183172:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111431168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048649.183194:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111431168:12345-0@lo:400:kworker.0 Request processed in 22us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048649.183211:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789048649.183245:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111430144:0@lo:400:kworker.0 00010000:00080000:2.0:1789048649.183256:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080e6a00 x1875953111430656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048649.183264:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111430656:0@lo:400:kworker.0 00010000:00080000:2.0:1789048649.183273:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b083b2300 x1875953111431168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048649.183283:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111431168:0@lo:400:kworker.0 00000100:00100000:2.0:1789048649.183294:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111430272:0@lo:400:kworker.0 00000100:00100000:0.0:1789048649.183603:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111429888:0@lo:400:kworker.0 00000100:00100000:0.0:1789048649.183646:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048649.183700:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111430400:0@lo:400:kworker.0 00000100:00100000:0.0:1789048649.183729:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048649.183767:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111430912:0@lo:400:kworker.0 00000100:00100000:0.0:1789048649.183790:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048649.183813:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111431424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048649.183833:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048649.183856:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789048649.183863:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111430016:0@lo:400:kworker.0 00000100:00100000:0.0:1789048649.183884:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048649.183904:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111430528:0@lo:400:kworker.0 00000100:00100000:0.0:1789048649.183923:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048649.183940:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111431040:0@lo:400:kworker.0 00000100:00100000:0.0:1789048649.183960:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048649.183990:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111430784 00000100:00100000:0.0:1789048649.183996:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111430784 00000100:00100000:0.0:1789048649.184033:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111431296 00000100:00100000:0.0:1789048649.184036:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111431296 00000100:00100000:0.0:1789048649.184056:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111430912 00000100:00100000:0.0:1789048649.184060:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111430912 00000100:00100000:0.0:1789048649.184076:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789048649.184084:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111430784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048649.184147:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111430784:12345-0@lo:400:kworker.0 Request processed in 46us (1536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048649.184153:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789048649.184170:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789048649.184176:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111431296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048649.184218:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111431296:12345-0@lo:400:kworker.0 Request processed in 41us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048649.184224:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789048649.184237:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789048649.184244:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1875953111430912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048649.184274:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1875953111430912:12345-0@lo:400:kworker.0 Request processed in 31us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048649.184279:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789048649.184305:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111431424 00000100:00100000:0.0:1789048649.184309:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111431424 00000100:00100000:0.0:1789048649.184329:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789048649.184375:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111431424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789048649.184390:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789048649.184420:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111431424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048649.184426:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789048649.184449:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111430016 00000100:00100000:0.0:1789048649.184453:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111430016 00000100:00100000:0.0:1789048649.184474:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111430528 00000100:00100000:0.0:1789048649.184477:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111430528 00000100:00100000:0.0:1789048649.184488:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111431040 00000100:00100000:0.0:1789048649.184489:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111431040 00000100:00100000:0.0:1789048649.184501:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789048649.184505:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111430016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048649.184531:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111430016:12345-0@lo:400:kworker.0 Request processed in 25us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048649.184536:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789048649.184552:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1789048649.184558:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111430528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048649.184581:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111430528:12345-0@lo:400:kworker.0 Request processed in 25us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048649.184586:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1789048649.184595:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789048649.184599:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111431040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048649.184620:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111431040:12345-0@lo:400:kworker.0 Request processed in 21us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048649.184625:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789048649.184685:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111430016:0@lo:400:kworker.0 00000100:00100000:0.0:1789048649.184696:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111430528:0@lo:400:kworker.0 00000100:00100000:0.0:1789048649.184705:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111431040:0@lo:400:kworker.0 00000100:00100000:0.0:1789048649.184714:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111430912:0@lo:400:kworker.0 00000100:00100000:0.0:1789048649.184728:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111431424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048649.184759:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111431296:0@lo:400:kworker.0 00000100:00100000:0.0:1789048649.184768:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111430784:0@lo:400:kworker.0 00000100:00080000:1.0:1789048649.185035:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789048649.185040:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789048649.185043:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789048649.185046:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789048649.185122:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111429888 00000100:00100000:2.0:1789048649.185127:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111429888 00000100:00100000:2.0:1789048649.185860:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1789048649.185868:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111429888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048649.185986:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111429888:12345-0@lo:400:kworker.0 Request processed in 117us (2338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048649.185993:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1789048649.186103:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111430400 00000100:00100000:3.0:1789048649.186109:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111430400 00000100:00100000:3.0:1789048649.186164:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789048649.186173:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111430400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048649.186214:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111430400:12345-0@lo:400:kworker.0 Request processed in 43us (2484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048649.186219:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789048649.197861:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111429888:0@lo:400:kworker.0 00000100:00100000:1.0:1789048649.197889:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111430400:0@lo:400:kworker.0 00000100:00100000:1.0:1789048649.694269:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111431552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048649.694417:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048649.694545:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111431552 00000100:00100000:1.0:1789048649.694555:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111431552 00000100:00100000:1.0:1789048649.694630:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789048649.694643:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111431552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789048649.694702:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789048649.694762:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111431552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048649.694771:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789048649.694833:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111431552:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789048649.696926:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048650.209110:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111431680:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048650.209219:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048650.209313:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789048650.209321:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111431808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789048650.209944:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111431680 00000100:00100000:2.0:1789048650.209956:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111431680 00000100:00100000:2.0:1789048650.210091:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789048650.210101:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111431680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789048650.210139:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789048650.210200:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111431680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048650.210225:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789048650.210475:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048650.210770:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111431680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789048650.211575:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111431808 00000100:00100000:0.0:1789048650.211585:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111431808 00000100:00100000:0.0:1789048650.211646:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789048650.211658:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875953111431808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789048650.211693:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789048650.211772:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875953111431808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (2397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048650.211790:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789048650.212055:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111431808:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1789048650.648400:0:14937:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 09:57:29 (1789048649) 00010000:00010000:0.0:1789048650.717730:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048651.232000:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111431936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048651.232072:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048651.232141:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111431936 00000100:00100000:3.0:1789048651.232148:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111431936 00000100:00100000:3.0:1789048651.232201:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789048651.232210:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111431936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789048651.232245:0:7806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789048651.232300:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111431936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048651.232306:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789048651.232505:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111431936:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1789048651.235181:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967530 is committed 00000020:00080000:0.0:1789048651.235196:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000004:00080000:0.0:1789048651.235221:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:3.0:1789048651.235268:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789048651.235279:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:2.0:1789048651.237719:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00010000:00010000:3.0:1789048651.742096:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048652.776126:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048652.861703:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048652.861749:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048652.861791:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048652.861825:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048652.861852:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048652.861874:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048652.861902:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048652.861932:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097751680 00000100:00100000:3.0:1789048652.861943:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097751680 00000100:00100000:0.0:1789048652.862122:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097751424 00000100:00100000:0.0:1789048652.862127:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097751424 00000100:00100000:0.0:1789048652.862169:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 406 00000100:00100000:0.0:1789048652.862179:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2391:x1875953097751424:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048652.862253:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2391:x1875953097751424:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 75us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048652.862260:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 406 00000100:00100000:1.0:1789048652.862372:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097752192 00000100:00100000:1.0:1789048652.862377:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097752192 00000100:00100000:1.0:1789048652.862416:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097751552 00000100:00100000:1.0:1789048652.862420:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097751552 00000100:00100000:1.0:1789048652.862436:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097752064 00000100:00100000:1.0:1789048652.862438:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097752064 00000100:00100000:1.0:1789048652.862456:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 370 00000100:00100000:1.0:1789048652.862463:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2391:x1875953097752192:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048652.862496:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2391:x1875953097752192:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 34us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048652.862503:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 370 00000100:00100000:1.0:1789048652.862516:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 371 00000100:00100000:1.0:1789048652.862522:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+19:2391:x1875953097751552:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048652.862551:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+19:2391:x1875953097751552:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 30us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048652.862556:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 371 00000100:00100000:1.0:1789048652.862567:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 372 00000100:00100000:1.0:1789048652.862572:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2391:x1875953097752064:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048652.862594:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2391:x1875953097752064:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 23us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048652.862599:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 372 00000100:00080000:1.0:1789048652.862615:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789048652.862619:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789048652.862659:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097751936 00000100:00100000:1.0:1789048652.862662:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097751936 00000100:00100000:1.0:1789048652.862704:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097751808 00000100:00100000:1.0:1789048652.862708:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097751808 00000100:00100000:1.0:1789048652.862749:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 140 00000100:00100000:1.0:1789048652.862755:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2391:x1875953097751936:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048652.862778:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2391:x1875953097751936:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 24us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048652.862783:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 140 00000100:00100000:1.0:1789048652.862792:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00100000:1.0:1789048652.862797:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2391:x1875953097751808:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048652.862814:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2391:x1875953097751808:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 18us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048652.862820:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00080000:1.0:1789048652.862839:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789048652.862842:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789048652.863611:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 373 00000100:00100000:1.0:1789048652.863622:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2391:x1875953097751680:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048652.863683:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2391:x1875953097751680:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 64us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048652.863698:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 373 00000100:00100000:3.0:1789048652.945218:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048652.945379:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097752320 00000100:00100000:1.0:1789048652.945390:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097752320 00000100:00100000:1.0:1789048652.945460:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 256 00000100:00100000:1.0:1789048652.945472:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:13171:x1875953097752320:12345-192.168.202.16@tcp:101:lsof.0 00010000:00010000:1.0:1789048652.945496:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048652.945521:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776ea8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29aac expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048652.945614:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776eaf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048652.945628:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776eaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048652.945650:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776eaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048652.945835:0:6499:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789048652.945839:0:6499:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789048652.945880:0:6499:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776eaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048652.945906:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1c00/0x133f221c08776ea8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29aac expref: 7 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048652.945925:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776eaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29aac expref: 6 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048652.945933:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfc600) 00010000:00010000:1.0:1789048652.945936:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789048652.945940:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1000, rc 0) 00000100:00100000:1.0:1789048652.946052:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:433baedb-13e1-412e-b0c8-ceb1dbfcf502+6:13171:x1875953097752320:12345-192.168.202.16@tcp:101:lsof.0 Request processed in 581us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048652.946059:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 256 00010000:00010000:0.0:1789048653.790293:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048654.301694:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789048654.301725:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111432064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048654.301822:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048654.301901:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111432448:0@lo:400:kworker.0 00000100:00100000:0.0:1789048654.301937:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048654.301938:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111432320:0@lo:400:kworker.0 00000100:00100000:0.0:1789048654.301968:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111432960:0@lo:400:kworker.0 00000100:00100000:2.0:1789048654.301980:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048654.302009:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111432832:0@lo:400:kworker.0 00000100:00100000:0.0:1789048654.302014:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048654.302039:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048654.302058:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875953111433344:0@lo:400:kworker.0 00000100:00100000:2.0:1789048654.302076:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048654.302094:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789048654.302100:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111432192:0@lo:400:kworker.0 00000100:00100000:2.0:1789048654.302130:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048654.302154:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111432704:0@lo:400:kworker.0 00000100:00100000:0.0:1789048654.302167:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111433472:0@lo:400:kworker.0 00000100:00100000:2.0:1789048654.302176:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048654.302197:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111433216:0@lo:400:kworker.0 00000100:00100000:0.0:1789048654.302204:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048654.302227:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048654.302244:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789048654.302254:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111432576:0@lo:400:kworker.0 00000100:00100000:2.0:1789048654.302277:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111432320 00000100:00100000:0.0:1789048654.302282:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048654.302287:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111432320 00000100:00100000:0.0:1789048654.302297:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111433088:0@lo:400:kworker.0 00000100:00100000:0.0:1789048654.302324:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048654.302366:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111432960 00000100:00100000:2.0:1789048654.302370:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111432960 00000100:00100000:0.0:1789048654.302371:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111433600:0@lo:400:kworker.0 00000100:00100000:0.0:1789048654.302397:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048654.302416:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1789048654.302425:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111432192 00000100:00100000:2.0:1789048654.302427:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111432320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048654.302432:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111432192 00000100:00100000:0.0:1789048654.302469:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1789048654.302477:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3621:x1875953111432192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048654.302489:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111432320:12345-0@lo:400:kworker.0 Request processed in 63us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048654.302498:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1789048654.302518:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111432832 00000100:00100000:0.0:1789048654.302518:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3621:x1875953111432192:12345-0@lo:400:kworker.0 Request processed in 40us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048654.302528:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1789048654.302531:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111432832 00000100:00100000:2.0:1789048654.302554:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111433344 00000100:00100000:2.0:1789048654.302558:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111433344 00000100:00100000:0.0:1789048654.302565:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111432448 00000100:00100000:0.0:1789048654.302571:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111432448 00000100:00100000:2.0:1789048654.302575:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111433472 00000100:00100000:2.0:1789048654.302580:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111433472 00000100:00100000:0.0:1789048654.302601:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111432704 00000100:00100000:0.0:1789048654.302607:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111432704 00000100:00100000:2.0:1789048654.302608:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111432576 00000100:00100000:2.0:1789048654.302613:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111432576 00000100:00100000:0.0:1789048654.302640:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789048654.302648:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111432448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048654.302684:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111432448:12345-0@lo:400:kworker.0 Request processed in 37us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048654.302691:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789048654.302702:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789048654.302707:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111432704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048654.302734:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111432704:12345-0@lo:400:kworker.0 Request processed in 27us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048654.302749:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789048654.302791:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111432448:0@lo:400:kworker.0 00000100:00100000:0.0:1789048654.302835:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111432064 00000100:00100000:0.0:1789048654.302839:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111432064 00000100:00100000:0.0:1789048654.302872:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789048654.302882:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111432064:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048654.302896:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111433728:0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789048654.302909:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048654.302931:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048654.302984:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111433728 00000100:00100000:3.0:1789048654.302988:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111433728 00000100:00100000:3.0:1789048654.303011:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789048654.303018:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111433728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789048654.303028:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048654.303059:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111433728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048654.303064:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789048654.303097:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111433728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048654.303128:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111432192:0@lo:400:kworker.0 00000100:00100000:3.0:1789048654.303138:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111432704:0@lo:400:kworker.0 00000100:00100000:3.0:1789048654.303148:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111432320:0@lo:400:kworker.0 00000100:00100000:3.0:1789048654.303189:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1789048654.303197:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111432960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048654.303229:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111432960:12345-0@lo:400:kworker.0 Request processed in 34us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048654.303235:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1789048654.303250:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1789048654.303256:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111432832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048654.303287:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111432832:12345-0@lo:400:kworker.0 Request processed in 32us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048654.303293:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1789048654.303304:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789048654.303311:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875953111433344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048654.303376:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875953111433344:12345-0@lo:400:kworker.0 Request processed in 66us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048654.303383:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789048654.303397:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1789048654.303405:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111433472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048654.303436:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111433472:12345-0@lo:400:kworker.0 Request processed in 33us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048654.303441:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1789048654.303472:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111432832:0@lo:400:kworker.0 00000100:00100000:1.0:1789048654.303476:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111433216 00000100:00100000:1.0:1789048654.303483:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111433216 00000100:00100000:3.0:1789048654.303484:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875953111433344:0@lo:400:kworker.0 00000100:00100000:1.0:1789048654.303525:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111433088 00000100:00100000:1.0:1789048654.303529:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111433088 00000100:00100000:0.0:1789048654.303579:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111432064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048654.303587:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00010000:00080000:0.0:1789048654.303618:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080d9880 x1875953111432960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048654.303644:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111432960:0@lo:400:kworker.0 00010000:00080000:0.0:1789048654.303657:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080db480 x1875953111433472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048654.303665:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111433472:0@lo:400:kworker.0 00000100:00100000:0.0:1789048654.303682:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111432064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048654.303998:0:8804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111433600 00000100:00100000:3.0:1789048654.304003:0:8804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111433600 00000100:00100000:3.0:1789048654.304023:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789048654.304030:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111433216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048654.304072:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111433216:12345-0@lo:400:kworker.0 Request processed in 42us (1846us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048654.304078:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789048654.304092:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789048654.304098:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111433088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048654.304132:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111433088:12345-0@lo:400:kworker.0 Request processed in 34us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048654.304137:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789048654.304148:0:8804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789048654.304154:0:8804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111433600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048654.304192:0:8804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111433600:12345-0@lo:400:kworker.0 Request processed in 39us (1794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048654.304198:0:8804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789048654.304232:0:3621:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1789048654.304238:0:3621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff959b0810ad80, transno 4294967325 00000100:00100000:3.0:1789048654.304250:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111433216:0@lo:400:kworker.0 00000100:00100000:2.0:1789048654.304495:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1789048654.304505:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111432576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048654.304543:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111432576:12345-0@lo:400:kworker.0 Request processed in 41us (2264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048654.304549:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00080000:2.0:1789048654.304605:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789048654.304610:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789048654.304612:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789048654.304615:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789048654.304645:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111432576:0@lo:400:kworker.0 00000100:00100000:2.0:1789048654.304656:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111433088:0@lo:400:kworker.0 00000100:00100000:2.0:1789048654.304666:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111433600:0@lo:400:kworker.0 00000100:00100000:2.0:1789048654.601002:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048654.601273:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097752576 00000100:00100000:3.0:1789048654.601284:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097752576 00000100:00080000:2.0:1789048654.601457:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048654.601501:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:3.0:1789048654.601513:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+19:13172:x1875953097752576:12345-192.168.202.16@tcp:35:umount.0 00000100:00100000:3.0:1789048654.601808:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:13172:x1875953097752576:12345-192.168.202.16@tcp:35:umount.0 Request processed in 296us (814us total) trans 4294967531 rc 0/0 00000100:00100000:3.0:1789048654.601815:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:3.0:1789048654.615451:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048654.615518:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097752832 00000100:00100000:1.0:1789048654.615529:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097752832 00000100:00100000:1.0:1789048654.615652:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:1.0:1789048654.615666:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+20:13172:x1875953097752832:12345-192.168.202.16@tcp:35:umount.0 00000100:00100000:1.0:1789048654.616020:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+21:13172:x1875953097752832:12345-192.168.202.16@tcp:35:umount.0 Request processed in 355us (574us total) trans 4294967532 rc 0/0 00000100:00100000:1.0:1789048654.616028:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:0.0:1789048654.619963:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048654.620534:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097753088 00000100:00100000:3.0:1789048654.620546:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097753088 00000100:00100000:3.0:1789048654.620731:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:3.0:1789048654.620742:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b2ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+21:13172:x1875953097753088:12345-192.168.202.16@tcp:35:umount.0 00000100:00100000:3.0:1789048654.621780:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b2ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+22:13172:x1875953097753088:12345-192.168.202.16@tcp:35:umount.0 Request processed in 1033us (1819us total) trans 4294967533 rc 0/0 00000100:00100000:3.0:1789048654.621790:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:2.0:1789048654.624686:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048654.624783:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097753344 00000100:00100000:1.0:1789048654.624795:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097753344 00000100:00100000:1.0:1789048654.624883:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:1.0:1789048654.624894:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+22:13172:x1875953097753344:12345-192.168.202.16@tcp:35:umount.0 00000100:00100000:1.0:1789048654.625239:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+23:13172:x1875953097753344:12345-192.168.202.16@tcp:35:umount.0 Request processed in 346us (561us total) trans 4294967534 rc 0/0 00000100:00100000:1.0:1789048654.625247:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:1.0:1789048654.632749:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048654.632787:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048654.632869:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048654.639214:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048654.640215:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097753472 00000100:00100000:3.0:1789048654.640226:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097753472 00000100:00100000:2.0:1789048654.641125:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097753728 00000100:00100000:2.0:1789048654.641134:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097753728 00000100:00100000:2.0:1789048654.641264:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097753600 00000100:00100000:2.0:1789048654.641269:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097753600 00000100:00100000:0.0:1789048654.641364:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:0.0:1789048654.641377:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+15:2394:x1875953097753728:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048654.641394:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048654.641415:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3c600/0x133f221c087760a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296d8 expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048654.641451:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048654.641521:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+14:2394:x1875953097753728:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 147us (8732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048654.641530:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:0.0:1789048654.641552:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:0.0:1789048654.641559:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+13:2394:x1875953097753600:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048654.641567:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048654.641576:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c420cc000/0x133f221c08775dd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b295c0 expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048654.641585:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048654.641605:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:2394:x1875953097753600:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 46us (8735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048654.641611:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:1.0:1789048654.642813:0:13167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:1.0:1789048654.642826:0:13167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ddb626-b82d-4fee-93aa-3a1f146cc67d+11:2394:x1875953097753472:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048654.642837:0:13167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048654.642850:0:13167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c013d7600/0x133f221c08775e8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b295ff expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048654.642863:0:13167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048654.642906:0:13167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2394:x1875953097753472:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 83us (10167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048654.642913:0:13167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:1.0:1789048654.642964:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097753856 00000100:00100000:1.0:1789048654.642971:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097753856 00000100:00100000:1.0:1789048654.643022:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 80 00000100:00100000:1.0:1789048654.643030:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2390:x1875953097753856:12345-192.168.202.16@tcp:9:umount.0 00000020:00000080:1.0:1789048654.643055:0:8413:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c087761b2 00000100:00080000:1.0:1789048654.643063:0:8413:0:(import.c:65:import_set_state_nolock()) ffff959c208a7000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789048654.643115:0:8413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:3.0:1789048654.643190:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048654.643243:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+2:2390:x1875953097753856:12345-192.168.202.16@tcp:9:umount.0 Request processed in 214us (4041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048654.643250:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 80 00000100:00080000:3.0:1789048654.643350:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789048654.647909:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048654.655079:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097754240 00000100:00100000:1.0:1789048654.655101:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097754240 00000100:00100000:1.0:1789048654.655201:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00100000:1.0:1789048654.655212:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+7:2390:x1875953097754240:12345-192.168.202.16@tcp:9:umount.0 00000020:00000080:1.0:1789048654.655250:0:8414:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08776428 00000020:00010000:1.0:1789048654.655258:0:8414:0:(genops.c:1920:obd_stale_export_put()) Put export ffff959c064a8000: total 0 00000100:00080000:1.0:1789048654.655263:0:8414:0:(import.c:65:import_set_state_nolock()) ffff959c064a8800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789048654.655310:0:8414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789048654.655501:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2390:x1875953097754240:12345-192.168.202.16@tcp:9:umount.0 Request processed in 289us (7605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048654.655508:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 81 00000020:00010000:3.0:1789048654.655522:0:6484:0:(genops.c:1906:obd_stale_export_get()) Get export ffff959c064a8000: total 0 00010000:00010000:3.0:1789048654.655576:0:6484:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff959c064a8000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1789048654.655641:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe7a04a4/0x133f221c087767e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298c9 expref: 4 pid: 8414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048654.655678:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000195acb85/0x133f221c08776ea1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29aa5 expref: 3 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048654.655691:0:6484:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff959c064a8000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1789048654.655704:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048654.655707:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048654.655708:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789048654.655811:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789048654.668751:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048654.668877:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097755264 00000100:00100000:1.0:1789048654.668887:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097755264 00000100:00100000:1.0:1789048654.668960:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 257 00000100:00100000:1.0:1789048654.668971:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+23:2390:x1875953097755264:12345-192.168.202.16@tcp:39:umount.0 00000020:00000080:1.0:1789048654.669030:0:6498:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775dde 00000020:00010000:1.0:1789048654.669059:0:6498:0:(genops.c:1920:obd_stale_export_put()) Put export ffff959b08013800: total 0 00000100:00080000:1.0:1789048654.669064:0:6498:0:(import.c:65:import_set_state_nolock()) ffff959b08014000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789048654.669097:0:6498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967534 00000100:00100000:1.0:1789048654.669276:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+22:2390:x1875953097755264:12345-192.168.202.16@tcp:39:umount.0 Request processed in 306us (535us total) trans 4294967535 rc 0/0 00000100:00100000:1.0:1789048654.669284:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 257 00000020:00010000:0.0:1789048654.669548:0:7447:0:(genops.c:1906:obd_stale_export_get()) Get export ffff959b08013800: total 0 00010000:00010000:0.0:1789048654.669603:0:7447:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff959b08013800, canceled 0 locks, left on hash table 14. 00010000:00010000:0.0:1789048654.669649:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:0.0:1789048654.669653:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789048654.669660:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb1000/0x133f221c08776b44 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b299be expref: 21 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048654.669689:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfc600) 00010000:00010000:0.0:1789048654.669692:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789048654.669697:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c0877683b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298de expref: 20 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048654.669726:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:0.0:1789048654.669729:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789048654.669733:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1e00/0x133f221c087766c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b2987c expref: 19 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048654.669744:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:0.0:1789048654.669747:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048654.669750:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0c00/0x133f221c087767b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298bb expref: 18 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048654.669763:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff959c3ef48300) 00010000:00010000:0.0:1789048654.669766:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789048654.669769:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c08776111 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296ed expref: 17 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048654.669787:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:0.0:1789048654.669790:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789048654.669793:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c04cb0e00/0x133f221c08776d82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a58 expref: 16 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048654.669805:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff959c4151a400) 00010000:00010000:0.0:1789048654.669807:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789048654.669810:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08776857 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298e5 expref: 15 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048654.669826:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:0.0:1789048654.669828:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789048654.669841:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1600/0x133f221c08776188 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29709 expref: 14 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048654.669858:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff959c02b11f00) 00010000:00010000:0.0:1789048654.669860:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789048654.669863:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08776483 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b297e2 expref: 13 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048654.669876:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:0.0:1789048654.669878:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048654.669881:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08776e62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a90 expref: 12 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048654.669892:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff959c05322a00) 00010000:00010000:0.0:1789048654.669894:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048654.669898:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837000/0x133f221c0877612d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296f4 expref: 11 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048654.669914:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:0.0:1789048654.669917:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789048654.669923:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c08776793 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298b4 expref: 10 pid: 8649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048654.669936:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff959c3ef1ee00) 00010000:00010000:0.0:1789048654.669938:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789048654.669941:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c08776e8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29a9e expref: 9 pid: 12131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048654.669964:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff959c02b11d00) 00010000:00010000:0.0:1789048654.669971:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789048654.669975:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c087767cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b298c2 expref: 8 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048654.669989:0:7447:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff959b08013800, canceled 14 locks, left on hash table 0. 00010000:00010000:0.0:1789048654.670003:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048654.670005:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048654.670007:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048654.685503:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048654.688666:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097755392 00000100:00100000:2.0:1789048654.688689:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097755392 00000100:00100000:2.0:1789048654.688793:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 258 00000100:00100000:2.0:1789048654.688803:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+5:2390:x1875953097755392:12345-192.168.202.16@tcp:39:umount.0 00000020:00000080:2.0:1789048654.688835:0:6497:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775de5 00000100:00080000:2.0:1789048654.688851:0:6497:0:(import.c:65:import_set_state_nolock()) ffff959b08012800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789048654.688970:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789048654.689275:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00000004:2.0:1789048654.689508:0:6497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789048654.690166:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b+3:2390:x1875953097755392:12345-192.168.202.16@tcp:39:umount.0 Request processed in 1124us (4433us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789048654.690177:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 258 00010000:00010000:3.0:1789048654.814096:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048654.814356:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111433856:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789048654.814429:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048654.814590:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111433856 00000100:00100000:1.0:1789048654.814598:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111433856 00000100:00100000:1.0:1789048654.814653:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789048654.814662:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111433856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789048654.814700:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789048654.814749:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111433856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048654.814756:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789048654.814877:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111433856:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789048655.325584:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789048655.325608:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111433984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048655.325694:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048655.325814:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111433984 00000100:00100000:2.0:1789048655.325822:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111433984 00000100:00100000:2.0:1789048655.325877:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789048655.325886:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111433984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789048655.325916:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789048655.325969:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111433984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048655.325976:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789048655.326183:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111433984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048655.326412:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111434112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048655.326439:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048655.326497:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111434112 00000100:00100000:0.0:1789048655.326502:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111434112 00000100:00100000:0.0:1789048655.326535:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789048655.326543:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111434112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789048655.326554:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789048655.327269:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111434112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 724us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048655.327277:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789048655.327514:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111434112:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789048655.837923:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048656.349885:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111434240:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048656.349986:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048656.350274:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111434240 00000100:00100000:1.0:1789048656.350284:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111434240 00000100:00100000:1.0:1789048656.350364:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789048656.350375:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111434240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789048656.350412:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789048656.350466:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111434240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048656.350473:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789048656.350649:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111434240:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1789048656.542014:0:13781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789048656.618777:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048656.618826:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048656.618876:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048656.618971:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097755520 00000100:00100000:3.0:1789048656.618985:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097755520 00000100:00100000:3.0:1789048656.619069:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097755776 00000100:00100000:3.0:1789048656.619072:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097755776 00000100:00100000:3.0:1789048656.619085:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097755648 00000100:00100000:3.0:1789048656.619087:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097755648 00000100:00100000:3.0:1789048656.619104:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:3.0:1789048656.619117:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+12:2393:x1875953097755520:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048656.619140:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048656.619168:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef39c00/0x133f221c08775ee1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29614 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048656.619193:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048656.619274:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+11:2393:x1875953097755520:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 161us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048656.619282:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:3.0:1789048656.619305:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:3.0:1789048656.619311:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+10:2393:x1875953097755776:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048656.619322:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048656.619380:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c02837200/0x133f221c087760e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b296df expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048656.619393:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048656.619411:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+9:2393:x1875953097755776:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 100us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048656.619417:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:3.0:1789048656.619430:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:3.0:1789048656.619435:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c013c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+8:2393:x1875953097755648:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048656.619458:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048656.619471:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef38c00/0x133f221c08775ee8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29645 expref: 8 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048656.619479:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048656.619499:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c013c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ddb626-b82d-4fee-93aa-3a1f146cc67d+7:2393:x1875953097755648:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 64us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048656.619507:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:1.0:1789048656.638288:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048656.638383:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097756032 00000100:00100000:2.0:1789048656.638393:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097756032 00000100:00100000:2.0:1789048656.638472:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 259 00000100:00100000:2.0:1789048656.638482:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+6:2390:x1875953097756032:12345-192.168.202.16@tcp:39:umount.0 00000020:00000080:2.0:1789048656.638523:0:8649:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775ef6 00000020:00010000:2.0:1789048656.638531:0:8649:0:(genops.c:1920:obd_stale_export_put()) Put export ffff959c3fb24800: total 0 00000100:00080000:2.0:1789048656.638547:0:8649:0:(import.c:65:import_set_state_nolock()) ffff959c3fb25800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789048656.638579:0:8649:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967535 00000100:00100000:2.0:1789048656.638770:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2390:x1875953097756032:12345-192.168.202.16@tcp:39:umount.0 Request processed in 288us (490us total) trans 4294967536 rc 0/0 00000100:00100000:2.0:1789048656.638777:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 259 00000020:00010000:0.0:1789048656.638975:0:6485:0:(genops.c:1906:obd_stale_export_get()) Get export ffff959c3fb24800: total 0 00010000:00010000:0.0:1789048656.638981:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048656.639026:0:6485:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff959c3fb24800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789048656.639059:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfc600) 00010000:00010000:0.0:1789048656.639063:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789048656.639071:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08776eaf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29aac expref: 4 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048656.639092:0:6485:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff959c3fb24800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789048656.639108:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048656.639110:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048656.639112:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789048656.639641:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048656.647516:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048656.647649:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097756160 00000100:00100000:2.0:1789048656.647668:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097756160 00000100:00100000:2.0:1789048656.647741:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 260 00000100:00100000:2.0:1789048656.647752:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:433baedb-13e1-412e-b0c8-ceb1dbfcf502+5:2390:x1875953097756160:12345-192.168.202.16@tcp:39:umount.0 00000020:00000080:2.0:1789048656.647796:0:12131:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775efd 00000100:00080000:2.0:1789048656.647805:0:12131:0:(import.c:65:import_set_state_nolock()) ffff959c3fb94800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789048656.647842:0:12131:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789048656.648007:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:433baedb-13e1-412e-b0c8-ceb1dbfcf502+3:2390:x1875953097756160:12345-192.168.202.16@tcp:39:umount.0 Request processed in 255us (499us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789048656.648015:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 260 00010000:00010000:0.0:1789048656.648132:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789048656.648281:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:2.0:1789048656.669544:0:13779:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789048656.669553:0:13779:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789048656.669668:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1789048656.669677:0:13779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789048656.704628:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048656.704738:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097756416 00000100:00100000:0.0:1789048656.704749:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097756416 00000100:00100000:0.0:1789048656.704814:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 408 00000100:00100000:0.0:1789048656.704824:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+7:2390:x1875953097756416:12345-192.168.202.16@tcp:251:umount.0 00000020:00000080:0.0:1789048656.704872:0:6492:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775dbb 00000020:00010000:0.0:1789048656.704880:0:6492:0:(genops.c:1920:obd_stale_export_put()) Put export ffff959b08016800: total 0 00000100:00080000:0.0:1789048656.704885:0:6492:0:(import.c:65:import_set_state_nolock()) ffff959b08017000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789048656.704976:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ddb626-b82d-4fee-93aa-3a1f146cc67d+3:2390:x1875953097756416:12345-192.168.202.16@tcp:251:umount.0 Request processed in 152us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048656.704984:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 408 00000020:00010000:1.0:1789048656.705252:0:7447:0:(genops.c:1906:obd_stale_export_get()) Get export ffff959b08016800: total 0 00010000:00010000:1.0:1789048656.705307:0:7447:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff959b08016800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789048656.705406:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c00031600/0x133f221c08775e94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29606 expref: 2 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048656.705421:0:7447:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff959b08016800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789048656.705433:0:7447:0:(genops.c:885:class_export_put()) final put ffff959b08016800/79ddb626-b82d-4fee-93aa-3a1f146cc67d 00010000:00010000:1.0:1789048656.705449:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048656.705452:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048656.705453:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789048656.705575:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff959b08016800/79ddb626-b82d-4fee-93aa-3a1f146cc67d for MGS 00000020:00000080:0.0:1789048656.705616:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b08017000 for MGS 00010000:00010000:0.0:1789048656.861583:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048657.888032:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789048658.384849:0:15132:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789048658.406484:0:15132:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789048658.406540:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02836a00/0x133f221c08775e63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e6a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048658.406556:0:15132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02836a00/0x133f221c08775e63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775e6a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048658.406564:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02836a00/0x133f221c08775e63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775e6a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048658.406571:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c02836a00/0x133f221c08775e63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775e6a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048658.406619:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789048658.406626:0:15132:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789048658.406655:0:15132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789048658.406661:0:15132:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789048658.406669:0:15132:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789048658.406696:0:15132:0:(import.c:65:import_set_state_nolock()) ffff959c3d2f1000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1789048658.406830:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048658.406838:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c02836a00/0x133f221c08775e63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775e6a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048658.406848:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836a00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048658.406851:0:7447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c02836a00/0x133f221c08775e63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775e6a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048658.406861:0:7447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c02836a00/0x133f221c08775e63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08775e6a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048658.406869:0:7447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c02836a00/0x133f221c08775e63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08775e6a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048658.406875:0:7447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789048658.406878:0:7447:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789048658.406881:0:7447:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789048658.406906:0:7447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c02836a00/0x133f221c08775e63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775e6a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048658.406912:0:7447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048658.406946:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c02836a00/0x133f221c08775e63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775e6a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048658.406960:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c02836a00/0x133f221c08775e63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775e6a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048658.406974:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048658.406976:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048658.406978:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048658.407026:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111434496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789048658.407093:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048658.407276:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111434496 00000100:00100000:1.0:1789048658.407283:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111434496 00000100:00100000:1.0:1789048658.407358:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789048658.407367:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3621:x1875953111434496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789048658.407390:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048658.407405:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c420cca00/0x133f221c08775e6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08775e63 expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048658.407417:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048658.407456:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:3621:x1875953111434496:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048658.407463:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789048658.407498:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111434496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048658.408115:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875953111434368:0@lo:39:umount.0 00000100:00100000:3.0:1789048658.408155:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048658.408202:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111434368 00000100:00100000:0.0:1789048658.408207:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111434368 00000100:00100000:0.0:1789048658.408248:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789048658.408255:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875953111434368:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789048658.408279:0:6497:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c087759d2 00000100:00080000:0.0:1789048658.408288:0:6497:0:(import.c:65:import_set_state_nolock()) ffff959c37fcc000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789048658.408371:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3619:x1875953111434368:12345-0@lo:39:umount.0 Request processed in 117us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048658.408388:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:0.0:1789048658.408396:0:6497:0:(genops.c:885:class_export_put()) final put ffff959c37fc8800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789048658.408420:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c37fc8800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789048658.408461:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c37fcc000 for lustre-MDT0000 00010000:00010000:3.0:1789048658.408933:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789048658.408959:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3d2f1000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789048658.408978:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875953111434368:0@lo:39:umount.0 00000100:00080000:0.0:1789048658.409005:0:15132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789048658.409009:0:15132:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789048658.409013:0:15132:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789048658.409994:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775e71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e78 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048658.410027:0:15132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775e71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775e78 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048658.410034:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775e71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775e78 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048658.410040:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775e71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775e78 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048658.410058:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789048658.410064:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00030800/0x133f221c08775d75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d7c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048658.410070:0:15132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00030800/0x133f221c08775d75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775d7c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048658.410075:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00030800/0x133f221c08775d75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775d7c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048658.410081:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c00030800/0x133f221c08775d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775d7c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048658.410093:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789048658.410099:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39400/0x133f221c087760d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087760e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048658.410105:0:15132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39400/0x133f221c087760d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087760e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048658.410120:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39400/0x133f221c087760d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c087760e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048658.410125:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c3ef39400/0x133f221c087760d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c087760e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048658.410136:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789048658.410141:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c0147a200/0x133f221c08775931 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775938 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048658.410148:0:15132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c0147a200/0x133f221c08775931 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775938 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048658.410154:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c0147a200/0x133f221c08775931 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775938 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048658.410160:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c0147a200/0x133f221c08775931 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775938 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048658.410167:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1789048658.410171:0:15132:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1789048658.410195:0:15132:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789048658.410200:0:15132:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1789048658.410204:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789048658.410209:0:15132:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1789048658.410214:0:15132:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff959b06b53000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789048658.410219:0:15132:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff959c3e83d000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789048658.410223:0:15132:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff959c3c4a9000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1789048658.410227:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000020:00080000:0.0:1789048658.410232:0:15132:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff959c4177d000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00010000:00010000:3.0:1789048658.410234:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775e71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775e78 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789048658.410239:0:15132:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff959c3fb24800 433baedb-13e1-412e-b0c8-ceb1dbfcf502 192.168.202.16@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1789048658.410241:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836c00 already unused, calling callback (ffffffffc1289c20) 00000020:00080000:0.0:1789048658.410244:0:15132:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff959b08013800 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 192.168.202.16@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967530 stale:0 10000000:00010000:3.0:1789048658.410245:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775e71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775e78 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789048658.410249:0:15132:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff959c394599c0) has exports, disconnecting them 00000020:00080000:0.0:1789048658.410253:0:15132:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff959b06b53000), last request at 1789048654 00010000:00010000:3.0:1789048658.410254:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775e71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08775e78 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789048658.410259:0:15132:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775ce2 10000000:00010000:3.0:1789048658.410260:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775e71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08775e78 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048658.410271:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:0.0:1789048658.410273:0:15132:0:(import.c:65:import_set_state_nolock()) ffff959b06b55000 : changing import state from FULL to CLOSED 10000000:01000000:3.0:1789048658.410274:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1789048658.410276:0:6485:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1789048658.410306:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775e71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775e78 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789048658.410308:0:15132:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959b06b53000): rc 0 00000020:00000080:0.0:1789048658.410310:0:15132:0:(genops.c:885:class_export_put()) final put ffff959b06b53000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1789048658.410313:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1789048658.410319:0:15132:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff959c3e83d000), last request at 1789048654 00000020:00000080:0.0:1789048658.410322:0:15132:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775bbc 00000100:00080000:0.0:1789048658.410326:0:15132:0:(import.c:65:import_set_state_nolock()) ffff959c3e83f800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789048658.410353:0:15132:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959c3e83d000): rc 0 00000020:00000080:0.0:1789048658.410355:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c3e83d000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1789048658.410356:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775e71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775e78 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789048658.410359:0:15132:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff959c3c4a9000), last request at 1789048414 00000020:00000080:0.0:1789048658.410362:0:15132:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775ab9 00010000:00010000:3.0:1789048658.410363:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c02836c00/0x133f221c08775e71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775e78 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789048658.410365:0:15132:0:(import.c:65:import_set_state_nolock()) ffff959c3c4a8800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789048658.410370:0:15132:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959c3c4a9000): rc 0 00000020:00000080:0.0:1789048658.410372:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c3c4a9000/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:3.0:1789048658.410376:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000020:00080000:0.0:1789048658.410376:0:15132:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff959c4177d000), last request at 1789048414 00010000:00010000:3.0:1789048658.410379:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c00030800/0x133f221c08775d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775d7c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789048658.410379:0:15132:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775a81 00000100:00080000:0.0:1789048658.410382:0:15132:0:(import.c:65:import_set_state_nolock()) ffff959c3c4a8000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789048658.410385:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c00030800 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:3.0:1789048658.410387:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c00030800/0x133f221c08775d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775d7c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1789048658.410388:0:15132:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967536 00010000:00010000:3.0:1789048658.410394:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c00030800/0x133f221c08775d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08775d7c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789048658.410399:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c00030800/0x133f221c08775d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08775d7c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048658.410404:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789048658.410406:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789048658.410407:0:6485:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789048658.410426:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c00030800/0x133f221c08775d75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775d7c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048658.410431:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789048658.410437:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c00030800/0x133f221c08775d75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775d7c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048658.410443:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c00030800/0x133f221c08775d75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775d7c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048658.410452:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789048658.410455:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef39400/0x133f221c087760d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c087760e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789048658.410455:0:15132:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959c4177d000): rc 0 00010000:00010000:3.0:1789048658.410460:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39400 already unused, calling callback (ffffffffc1289c20) 00000004:00000080:0.0:1789048658.410461:0:15132:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb770c7ef7ae0 10000000:00010000:3.0:1789048658.410463:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef39400/0x133f221c087760d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c087760e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048658.410468:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef39400/0x133f221c087760d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c087760e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789048658.410473:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef39400/0x133f221c087760d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c087760e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789048658.410476:0:15132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 10000000:01000000:3.0:1789048658.410478:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789048658.410480:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789048658.410481:0:6485:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:0.0:1789048658.410483:0:15132:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1789048658.410490:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c3ef39400/0x133f221c087760d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c087760e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048658.410495:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789048658.410509:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef39400/0x133f221c087760d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c087760e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048658.410520:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef39400/0x133f221c087760d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c087760e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048658.410529:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048658.410532:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c0147a200/0x133f221c08775931 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775938 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048658.410538:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c0147a200 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:3.0:1789048658.410540:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c0147a200/0x133f221c08775931 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775938 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048658.410547:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c0147a200/0x133f221c08775931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08775938 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789048658.410554:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c0147a200/0x133f221c08775931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08775938 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048658.410559:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789048658.410561:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789048658.410563:0:6485:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789048658.410572:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c0147a200/0x133f221c08775931 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775938 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048658.410577:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789048658.410583:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c0147a200/0x133f221c08775931 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775938 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048658.410605:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c0147a200/0x133f221c08775931 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775938 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048658.410624:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048658.410626:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048658.410628:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048658.411085:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111434624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048658.411140:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048658.411184:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789048658.411190:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111434752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048658.411208:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048658.411234:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111434880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048658.411252:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789048658.411259:0:15132:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789048658.411268:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789048658.411272:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111435008:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789048658.411273:0:15132:0:(import.c:65:import_set_state_nolock()) ffff959c41778000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789048658.411289:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048658.411314:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111434624 00000100:00100000:3.0:1789048658.411321:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111434624 00000100:00100000:3.0:1789048658.411383:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111434752 00000100:00100000:3.0:1789048658.411387:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111434752 00000100:00100000:3.0:1789048658.411399:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111434880 00000100:00100000:3.0:1789048658.411401:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111434880 00000100:00100000:3.0:1789048658.411411:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111435008 00000100:00100000:3.0:1789048658.411413:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111435008 00000100:00100000:3.0:1789048658.411427:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789048658.411435:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08847800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+26:3622:x1875953111434624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789048658.411447:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048658.411462:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c013d7400/0x133f221c08775e78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08775e71 expref: 26 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048658.411486:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048658.411523:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08847800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+25:3622:x1875953111434624:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048658.411530:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1789048658.411545:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048658.411548:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1789048658.411551:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048658.411554:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+24:3622:x1875953111434752:12345-0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1789048658.411560:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff959b06b53000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:3.0:1789048658.411561:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048658.411569:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c02836000/0x133f221c08775d7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08775d75 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048658.411578:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:1.0:1789048658.411611:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3e83d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1789048658.411614:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+23:3622:x1875953111434752:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048658.411619:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789048658.411630:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000020:00000080:1.0:1789048658.411633:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3c4a9000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789048658.411654:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b06b55000 for lustre-MDT0000 00000020:00000080:1.0:1789048658.411658:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c3e83f800 for lustre-MDT0000 00000020:00000080:1.0:1789048658.411669:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c3c4a8800 for lustre-MDT0000 00000100:00100000:0.0:1789048658.411748:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111434752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789048658.411757:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111434624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048658.412818:0:13167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789048658.412834:0:13167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+22:3620:x1875953111435008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048658.412846:0:13167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048658.412862:0:13167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c02837a00/0x133f221c08775938 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08775931 expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048658.412875:0:13167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048658.414811:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08844e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+21:3620:x1875953111434880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789048658.414840:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048658.414861:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3cc00/0x133f221c087760e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c087760d9 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048658.414878:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048658.414962:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08844e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+20:3620:x1875953111434880:12345-0@lo:103:ldlm_bl.0 Request processed in 3326us (3708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048658.414971:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789048658.415049:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111434880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048658.415121:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111435136:0@lo:39:umount.0 00000100:00100000:3.0:1789048658.415155:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789048658.415163:0:15132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789048658.415169:0:15132:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1789048658.415183:0:15132:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789048658.415258:0:15132:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789048658.415280:0:15132:0:(import.c:65:import_set_state_nolock()) ffff959b06839800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789048658.415301:0:15132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789048658.415304:0:15132:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1789048658.415310:0:15132:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789048658.415328:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111435264:0@lo:9:umount.0 00000100:00100000:3.0:1789048658.415374:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789048658.415395:0:15132:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1789048658.415404:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111435264 00000100:00080000:1.0:1789048658.415404:0:15132:0:(import.c:65:import_set_state_nolock()) ffff959b0802b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789048658.415410:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111435264 00000020:00080000:1.0:1789048658.415437:0:15132:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff959c394599c0) has no exports 00000100:00100000:3.0:1789048658.415456:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789048658.415464:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875953111435264:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789048658.415490:0:8413:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775c72 00000100:00080000:3.0:1789048658.415498:0:8413:0:(import.c:65:import_set_state_nolock()) ffff959b05da5000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789048658.415547:0:8413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1789048658.415565:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111435136 00000100:00100000:0.0:1789048658.415569:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111435136 00000100:00100000:0.0:1789048658.415609:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789048658.415615:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875953111435136:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789048658.415631:0:7806:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775b14 00000100:00080000:0.0:1789048658.415636:0:7806:0:(import.c:65:import_set_state_nolock()) ffff959c4177b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789048658.415653:0:7806:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1789048658.415679:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3619:x1875953111435264:12345-0@lo:9:umount.0 Request processed in 216us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048658.415686:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1789048658.415703:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789048658.415750:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3619:x1875953111435136:12345-0@lo:39:umount.0 Request processed in 134us (595us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789048658.415756:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111435392:0@lo:9:umount.0 00000100:00100000:0.0:1789048658.415757:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00010000:00010000:0.0:1789048658.415776:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048658.415779:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048658.415801:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111435392 00000100:00100000:0.0:1789048658.415804:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111435392 00000100:00080000:3.0:1789048658.415808:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b06839800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789048658.415815:0:3619:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789048658.415817:0:3619:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789048658.415819:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111435264:0@lo:9:umount.0 00000100:00100000:0.0:1789048658.415829:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1789048658.415830:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c41778000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789048658.415835:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111435136:0@lo:39:umount.0 00000100:00100000:0.0:1789048658.415835:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875953111435392:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789048658.415847:0:8414:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775db4 00000100:00080000:0.0:1789048658.415852:0:8414:0:(import.c:65:import_set_state_nolock()) ffff959c416de000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789048658.415880:0:8414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789048658.415971:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3619:x1875953111435392:12345-0@lo:9:umount.0 Request processed in 136us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048658.415986:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1789048658.416002:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789048658.416010:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048658.416113:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789048658.417857:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b0802b800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789048658.417886:0:3619:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789048658.417888:0:3619:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789048658.417893:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111435392:0@lo:9:umount.0 00000100:00100000:2.0:1789048658.418091:0:13167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:3620:x1875953111435008:12345-0@lo:103:ldlm_bl.0 Request processed in 5261us (6798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048658.418102:0:13167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789048658.418411:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111435008:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789048658.427726:0:15132:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff959c394599c0) has no exports 00000020:00000080:0.0:1789048658.495393:0:15132:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c0877598c 00000020:00000080:0.0:1789048658.495408:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c2023f000/lustre-QMT0000_UUID 00000020:01000000:0.0:1789048658.495433:0:15132:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789048658.496773:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2023f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789048658.496808:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789048658.496817:0:15132:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789048658.496821:0:15132:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff959c20a019c0) has no exports 00000020:00000080:1.0:1789048658.497201:0:15132:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775985 00000020:00000080:1.0:1789048658.497209:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c3d2f0800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789048658.497259:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789048658.497267:0:15132:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789048658.497270:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c08a86800/lustre-QMT0000_UUID 00000020:00000080:1.0:1789048658.497272:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff959c08a86800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789048658.497276:0:15132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1789048658.497749:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3d2f0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1789048658.909659:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048659.425602:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111435776:0@lo:400:kworker.0 00000100:00100000:0.0:1789048659.425674:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048659.425841:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111435904:0@lo:400:kworker.0 00000100:00100000:1.0:1789048659.425877:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048659.425924:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111435776 00000100:00100000:1.0:1789048659.425932:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111435776 00000100:00100000:1.0:1789048659.425971:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111435904 00000100:00100000:1.0:1789048659.425973:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111435904 00000100:00100000:1.0:1789048659.426007:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789048659.426013:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3620:x1875953111435776:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789048659.426021:0:6498:0:(tgt_handler.c:811:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789048659.426058:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3620:x1875953111435776:12345-0@lo:400:kworker.0 Request processed in 43us (383us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789048659.426077:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789048659.426096:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789048659.426100:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3621:x1875953111435904:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789048659.426105:0:6498:0:(tgt_handler.c:811:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789048659.426133:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3621:x1875953111435904:12345-0@lo:400:kworker.0 Request processed in 31us (256us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789048659.426138:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789048659.426785:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111435648:0@lo:400:kworker.0 00000100:00100000:3.0:1789048659.426825:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048659.426868:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111435648 00000100:00100000:3.0:1789048659.426873:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111435648 00000100:00100000:3.0:1789048659.426951:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789048659.426959:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3623:x1875953111435648:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789048659.426965:0:6503:0:(tgt_handler.c:811:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789048659.426997:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3623:x1875953111435648:12345-0@lo:400:kworker.0 Request processed in 38us (172us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789048659.427003:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:0.0:1789048659.427321:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789048659.427327:0:3620:0:(import.c:65:import_set_state_nolock()) ffff959c3e9df800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789048659.427350:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1789048659.427813:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111435520:0@lo:400:kworker.0 00000100:00100000:2.0:1789048659.427858:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048659.427894:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111435520 00000100:00100000:2.0:1789048659.427912:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111435520 00000100:00100000:2.0:1789048659.427950:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1789048659.427957:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:3622:x1875953111435520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048659.427998:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17f7b908-b8ce-4c14-97e3-2e83ca6f061b+19:3622:x1875953111435520:12345-0@lo:400:kworker.0 Request processed in 42us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048659.428004:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00080000:3.0:1789048659.428154:0:3621:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789048659.428158:0:3621:0:(import.c:65:import_set_state_nolock()) ffff959c3e9dc800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789048659.428161:0:3621:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789048659.428166:0:3621:0:(import.c:65:import_set_state_nolock()) ffff959c3e9dc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789048659.428171:0:3621:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 191 00000100:00080000:3.0:1789048659.428179:0:3621:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff959c3e9dc800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048659.428205:0:3621:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b08847b80 x1875953111436800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048659.428227:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111435904:0@lo:400:kworker.0 00000100:00100000:3.0:1789048659.428235:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111436416:0@lo:400:kworker.0 00000100:00100000:3.0:1789048659.428263:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048659.428320:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111436416 00000100:00100000:3.0:1789048659.428324:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111436416 00000100:00100000:3.0:1789048659.428394:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1789048659.428402:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111436416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048659.428439:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111436416:12345-0@lo:400:kworker.0 Request processed in 39us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048659.428460:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1789048659.428486:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111436800:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1789048659.428512:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789048659.428547:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07b12d80 x1875953111436416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048659.428558:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111436416:0@lo:400:kworker.0 00000100:00080000:3.0:1789048659.428595:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789048659.430941:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111436800 00000100:00100000:1.0:1789048659.430958:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111436800 00000100:00100000:1.0:1789048659.431014:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789048659.431023:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875953111436800:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1789048659.431042:0:6499:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1789048659.431164:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789048659.431169:0:3623:0:(import.c:65:import_set_state_nolock()) ffff959c41788000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789048659.431172:0:3623:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789048659.431177:0:3623:0:(import.c:65:import_set_state_nolock()) ffff959c41788000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048659.431182:0:3623:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 168 00000100:00080000:2.0:1789048659.431192:0:3623:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff959c41788000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048659.431227:0:3623:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080e6a00 x1875953111436928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789048659.431255:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111435648:0@lo:400:kworker.0 00000100:00100000:2.0:1789048659.431266:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111436160:0@lo:400:kworker.0 00000100:00100000:2.0:1789048659.431349:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048659.431388:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111436672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789048659.431435:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048659.431497:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111436160 00000100:00100000:2.0:1789048659.431502:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111436160 00000100:00100000:2.0:1789048659.431547:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789048659.431554:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111436160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048659.431643:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111436160:12345-0@lo:400:kworker.0 Request processed in 88us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048659.431650:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789048659.431673:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111436672 00000100:00100000:2.0:1789048659.431676:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111436672 00000100:00100000:2.0:1789048659.431702:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789048659.431721:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111436672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789048659.431743:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789048659.431774:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111436672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048659.431779:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:2.0:1789048659.431800:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789048659.431804:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048659.431827:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111435520:0@lo:400:kworker.0 00000100:00100000:2.0:1789048659.431834:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111436032:0@lo:400:kworker.0 00000100:00100000:2.0:1789048659.431858:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048659.431877:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111436544:0@lo:400:kworker.0 00000100:00100000:2.0:1789048659.431896:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048659.431935:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111436032 00000100:00100000:2.0:1789048659.431939:0:12131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111436032 00000100:00100000:2.0:1789048659.431970:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1789048659.431976:0:12131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111436032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048659.432018:0:12131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111436032:12345-0@lo:400:kworker.0 Request processed in 42us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048659.432025:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00080000:2.0:1789048659.432040:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789048659.432058:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07b11880 x1875953111436032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048659.432068:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111436032:0@lo:400:kworker.0 00000100:00100000:2.0:1789048659.432087:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111436928:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1789048659.432114:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048659.432142:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111436928 00000100:00100000:2.0:1789048659.432146:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111436928 00000100:00100000:2.0:1789048659.432162:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789048659.432166:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875953111436928:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1789048659.432178:0:6502:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789048659.432211:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875953111436928:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 44us (96us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789048659.432217:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:2.0:1789048659.432239:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c41788000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048659.432243:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789048659.432246:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111436928:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1789048659.432271:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111436160:0@lo:400:kworker.0 00000100:00100000:2.0:1789048659.432285:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111436672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789048659.432381:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111436544 00000100:00100000:2.0:1789048659.432386:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111436544 00000100:00100000:2.0:1789048659.432417:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789048659.432424:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111436544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048659.432459:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111436544:12345-0@lo:400:kworker.0 Request processed in 36us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048659.432464:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789048659.432488:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111436544:0@lo:400:kworker.0 00000100:00100000:1.0:1789048659.482771:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875953111436800:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 51743us (54253us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789048659.482785:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1789048659.483236:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3e9dc800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048659.483244:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789048659.483248:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111436800:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1789048659.492378:0:3620:0:(import.c:65:import_set_state_nolock()) ffff959c3e9df800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789048659.492392:0:3620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 168 00000100:00080000:0.0:1789048659.492408:0:3620:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff959c3e9df800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048659.492484:0:3620:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080db800 x1875953111437056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789048659.492516:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111435776:0@lo:400:kworker.0 00000100:00100000:0.0:1789048659.492528:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111436288:0@lo:400:kworker.0 00000100:00100000:0.0:1789048659.493059:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048659.493342:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875953111437056:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789048659.493381:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048659.493515:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111436288 00000100:00100000:1.0:1789048659.493524:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111436288 00000100:00100000:1.0:1789048659.493570:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111437056 00000100:00100000:1.0:1789048659.493574:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111437056 00000100:00100000:1.0:1789048659.493611:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789048659.493618:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3620:x1875953111436288:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789048659.493636:0:6498:0:(tgt_handler.c:811:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789048659.493684:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3620:x1875953111436288:12345-0@lo:400:kworker.0 Request processed in 65us (627us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789048659.493705:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789048659.493723:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789048659.493728:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1875953111437056:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1789048659.493746:0:6498:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789048659.493779:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1875953111437056:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 50us (398us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789048659.493785:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1789048659.493818:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789048659.493822:0:3620:0:(import.c:65:import_set_state_nolock()) ffff959b0758e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789048659.493826:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789048659.493831:0:3620:0:(import.c:65:import_set_state_nolock()) ffff959b0758e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789048659.493835:0:3620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 215 00000100:00080000:1.0:1789048659.493844:0:3620:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff959b0758e800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048659.493866:0:3620:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fb9ea00 x1875953111437184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789048659.493883:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111436288:0@lo:400:kworker.0 00000100:00100000:2.0:1789048659.494103:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111437184:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789048659.494133:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789048659.494172:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3e9df800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048659.494178:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789048659.494182:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875953111437056:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789048659.494487:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111437184 00000100:00100000:1.0:1789048659.494492:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111437184 00000100:00100000:1.0:1789048659.494520:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789048659.494526:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875953111437184:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1789048659.494536:0:6499:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789048659.494570:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875953111437184:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 44us (436us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789048659.494589:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:2.0:1789048659.496647:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b0758e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048659.496657:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789048659.496662:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111437184:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1789048659.934680:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048660.446536:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789048660.446563:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111437312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048660.446654:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048660.446727:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111437312 00000100:00100000:0.0:1789048660.446736:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111437312 00000100:00100000:0.0:1789048660.446784:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789048660.446794:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111437312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789048660.446823:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789048660.446878:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111437312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048660.446885:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789048660.447015:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111437312:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1789048660.455473:0:9492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789048660.455485:0:9492:0:(genops.c:885:class_export_put()) final put ffff959c416db800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789048660.455514:0:9492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 00000020:00000080:1.0:1789048660.455517:0:9492:0:(genops.c:885:class_export_put()) final put ffff959c3fb90000/85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 00000020:00000080:3.0:1789048660.455580:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c416db800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789048660.455660:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3fb90000/85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b for lustre-OST0001 00000020:00000080:3.0:1789048660.455677:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c416de000 for lustre-OST0001 00000020:00000080:3.0:1789048660.455684:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c208a7000 for lustre-OST0001 00000001:00100000:2.0:1789048660.457053:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789048660.457060:0:8407:0:(genops.c:885:class_export_put()) final put ffff959b05da0800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789048660.457088:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 00000020:00000080:2.0:1789048660.457090:0:8407:0:(genops.c:885:class_export_put()) final put ffff959c064a8000/85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 00000020:00000080:1.0:1789048660.457154:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff959b05da0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789048660.457200:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff959c064a8000/85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b for lustre-OST0000 00000020:00000080:1.0:1789048660.457221:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b05da5000 for lustre-OST0000 00000020:00000080:1.0:1789048660.457225:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c064a8800 for lustre-OST0000 00000001:00100000:2.0:1789048660.457434:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789048660.457453:0:6475:0:(genops.c:885:class_export_put()) final put ffff959c4177d000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789048660.457477:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 433baedb-13e1-412e-b0c8-ceb1dbfcf502 00000001:00080000:2.0:1789048660.457485:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967536 is committed 00000020:00000080:2.0:1789048660.457488:0:6475:0:(genops.c:885:class_export_put()) final put ffff959c3fb24800/433baedb-13e1-412e-b0c8-ceb1dbfcf502 00000001:00100000:2.0:1789048660.457493:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 00000001:00080000:2.0:1789048660.457497:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967535 is committed 00000020:00000080:2.0:1789048660.457505:0:6475:0:(genops.c:885:class_export_put()) final put ffff959b08013800/85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 00000020:00000080:3.0:1789048660.457560:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c4177d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1789048660.457623:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3fb24800/433baedb-13e1-412e-b0c8-ceb1dbfcf502 for lustre-MDT0000 00000020:00000080:3.0:1789048660.457644:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b08013800/85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b for lustre-MDT0000 00000020:00000080:3.0:1789048660.457687:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c3c4a8000 for lustre-MDT0000 00000020:00000080:3.0:1789048660.457691:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c3fb25800 for lustre-MDT0000 00000020:00000080:3.0:1789048660.457694:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b08014000 for lustre-MDT0000 00000001:00100000:3.0:1789048660.459265:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789048660.459278:0:7428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1789048660.459283:0:7428:0:(genops.c:885:class_export_put()) final put ffff959c2ac8a000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789048660.459400:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 433baedb-13e1-412e-b0c8-ceb1dbfcf502 00000001:00080000:3.0:1789048660.459416:0:7428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1789048660.459418:0:7428:0:(genops.c:885:class_export_put()) final put ffff959b0802f800/433baedb-13e1-412e-b0c8-ceb1dbfcf502 00000001:00100000:3.0:1789048660.464426:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 00000001:00080000:3.0:1789048660.464440:0:7428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1789048660.464445:0:7428:0:(genops.c:885:class_export_put()) final put ffff959b08011000/85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b 00000020:00000080:1.0:1789048660.464475:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2ac8a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1789048660.477274:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff959b0802f800/433baedb-13e1-412e-b0c8-ceb1dbfcf502 for lustre-MDT0001 00000020:00000080:1.0:1789048660.477376:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff959b08011000/85bc6bc9-f6a0-4896-ac1a-3fbb5f390e4b for lustre-MDT0001 00000020:00000080:1.0:1789048660.477420:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c4177b800 for lustre-MDT0001 00000020:00000080:1.0:1789048660.477426:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c3fb94800 for lustre-MDT0001 00000020:00000080:1.0:1789048660.477429:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b08012800 for lustre-MDT0001 00000020:01000000:2.0:1789048660.513904:0:15132:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff959b07a0ff00 - data ffff959b06089000/ffff959c41556c00 00000020:01000000:2.0:1789048660.514103:0:15132:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff959c049259c0 - data ffff959c3917a288/ffff959c08af5800 00000001:00000004:2.0:1789048660.525170:0:15132:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967536 00000100:00080000:0.0:1789048660.632037:0:15132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789048660.632046:0:15132:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1789048660.632073:0:15132:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff959b07b12a00 x1875953111435136/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789048668 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048660.632100:0:15132:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789048660.644015:0:15132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789048660.644024:0:15132:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1789048660.644082:0:15132:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789048660.644086:0:15132:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789048660.650700:0:8800:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789048660.650709:0:8800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1789048660.650728:0:8800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789048660.651513:0:15132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789048660.651518:0:15132:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1789048660.651645:0:15132:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789048660.651658:0:15132:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789048660.658134:0:9902:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789048660.658143:0:9902:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1789048660.658157:0:9902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789048660.659928:0:15132:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775954 00000020:00000080:0.0:1789048660.659941:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c2ac89000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789048660.666386:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2ac89000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789048660.666532:0:15132:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775969 00000020:00000080:0.0:1789048660.666839:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c2023c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789048660.666856:0:15132:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789048660.666871:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789048660.666880:0:15132:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789048660.666884:0:15132:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff959c3945cd40) has no exports 00000004:01000000:0.0:1789048660.667052:0:15132:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789048660.667070:0:15132:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775d9f 00000020:00000080:0.0:1789048660.667075:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c416de800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789048660.667079:0:15132:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789048660.667081:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789048660.667091:0:15132:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789048660.667094:0:15132:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff959c3e883380) has no exports 00000020:00000080:0.0:1789048660.667100:0:15132:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775d98 00000020:00000080:0.0:1789048660.667104:0:15132:0:(genops.c:885:class_export_put()) final put ffff959b0802f000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1789048660.667493:0:15132:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789048660.667499:0:15132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789048660.667504:0:15132:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1789048660.667509:0:15132:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789048660.667511:0:15132:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789048660.668076:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2023c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1789048660.668088:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c416de800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789048660.668096:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b0802f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789048660.668102:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b0802b800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789048660.669502:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789048660.669522:0:15132:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789048660.669528:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c416dd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789048660.669904:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff959c416dd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789048660.669914:0:15132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789048660.670014:0:15132:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775c5d 00000020:00000080:0.0:1789048660.670021:0:15132:0:(genops.c:885:class_export_put()) final put ffff959b05da1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789048660.670089:0:15132:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789048660.670095:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789048660.670102:0:15132:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789048660.670107:0:15132:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff959c03e419c0) has no exports 00000020:00000080:0.0:1789048660.670113:0:15132:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775c56 00000020:00000080:0.0:1789048660.670117:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c416d8800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789048660.674582:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b05da1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1789048660.677362:0:15132:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789048660.677370:0:15132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789048660.677374:0:15132:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1789048660.677382:0:15132:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789048660.677384:0:15132:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789048660.680166:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c416d8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789048660.681982:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789048660.682013:0:15132:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1789048660.682029:0:15132:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789048660.682037:0:15132:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775b0d 00000020:00000080:0.0:1789048660.682047:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c3e9bb000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789048660.682053:0:15132:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1789048660.682057:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789048660.682063:0:15132:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789048660.682066:0:15132:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff959c03e40000) has no exports 00000020:00000080:0.0:1789048660.682074:0:15132:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775b06 00000020:00000080:0.0:1789048660.682078:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c4177d800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789048660.682859:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b06839800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789048660.682872:0:36:0:(genops.c:885:class_export_put()) final put ffff959c416df000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789048660.682875:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c416df000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789048660.682882:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789048660.682962:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3e9bb000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789048660.682975:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c4177d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789048660.685382:0:15132:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1789048660.685391:0:15132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789048660.685394:0:15132:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1789048660.685403:0:15132:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789048660.685449:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789048660.685461:0:15132:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789048660.685486:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789048660.685488:0:15132:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789048660.685493:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c2ac8e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789048660.685497:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2ac8e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789048660.685504:0:15132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789048660.685632:0:15132:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775970 00000020:00000080:1.0:1789048660.685639:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c2023d000/lustre-MDD0000_UUID 00000020:01000000:1.0:1789048660.685643:0:15132:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789048660.685657:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789048660.685663:0:15132:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789048660.685666:0:15132:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff959c2022b380) has no exports 00000020:00000080:1.0:1789048660.685683:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789048660.685686:0:15132:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789048660.685690:0:15132:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775977 00000020:00000080:1.0:1789048660.685694:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c2023b000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789048660.685703:0:15132:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959c335d0800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789048660.685706:0:15132:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c335d0800 3 00000020:01000004:1.0:1789048660.685709:0:15132:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff959c335d0800 from lustre-MDT0000 00000020:00000080:1.0:1789048660.685726:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789048660.685729:0:15132:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789048660.685732:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c2ac8c000/lustre-MDT0000_UUID 00000020:00000080:1.0:1789048660.685734:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2ac8c000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789048660.685740:0:15132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789048660.685768:0:15132:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1789048660.685782:0:15132:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789048660.685785:0:15132:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789048660.685787:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789048660.685790:0:15132:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789048660.685796:0:15132:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff959c33592000 17f7b908-b8ce-4c14-97e3-2e83ca6f061b 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789048660.685801:0:15132:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff959c20a04d40) has exports, disconnecting them 00000020:00080000:1.0:1789048660.685806:0:15132:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff959c33592000), last request at 1789048394 00000020:00000080:1.0:1789048660.685819:0:15132:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775915 00000020:00010000:1.0:1789048660.685823:0:15132:0:(genops.c:1920:obd_stale_export_put()) Put export ffff959c33592000: total 2 00000100:00080000:1.0:1789048660.685828:0:15132:0:(import.c:65:import_set_state_nolock()) ffff959c33597000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789048660.685841:0:15132:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959c33592000): rc 0 00000020:00080000:1.0:1789048660.685844:0:15132:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff959c20a04d40) has no exports 00000020:00010000:1.0:1789048660.685853:0:6485:0:(genops.c:1906:obd_stale_export_get()) Get export ffff959c33592000: total 2 00010000:00010000:1.0:1789048660.685878:0:6485:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff959c33592000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789048660.685904:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3dc00/0x133f221c087760c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c087760bd expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048660.685921:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c0147a600/0x133f221c08775a1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08775a18 expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048660.685935:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef38400/0x133f221c087760b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c087760af expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048660.685947:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c013d6200/0x133f221c08775e86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08775e7f expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048660.685958:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c013d6600/0x133f221c08775e16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08775e0f expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048660.685968:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c420cda00/0x133f221c08775e24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08775e1d expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048660.685992:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c02837400/0x133f221c087760d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c087760cb expref: 8 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048660.686005:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c02837c00/0x133f221c08775d36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08775d2f expref: 7 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048660.686016:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c02836e00/0x133f221c08775e32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08775e2b expref: 6 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048660.686027:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c013d7200/0x133f221c08775e40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08775e39 expref: 5 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048660.686037:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c02836800/0x133f221c08775e4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08775e47 expref: 4 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048660.686046:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c013d7e00/0x133f221c08775a11 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08775a0a expref: 3 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048660.686056:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c013d7a00/0x133f221c08775e5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08775e55 expref: 2 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048660.686065:0:6485:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff959c33592000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1789048660.686079:0:6485:0:(genops.c:885:class_export_put()) final put ffff959c33592000/17f7b908-b8ce-4c14-97e3-2e83ca6f061b 00010000:00010000:1.0:1789048660.686085:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048660.686086:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048660.686088:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048660.687445:0:6491:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff959c20a52200:6491] 1 exiting: rc = 0 00000100:00100000:2.0:1789048660.687546:0:6490:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff959c034c6000:6490] 0 exiting: rc = 1 00000100:00100000:2.0:1789048660.687623:0:6492:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff959c20a52600:6492] 2 exiting: rc = 0 00000020:00000080:2.0:1789048660.687670:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c41778000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1789048660.687680:0:36:0:(genops.c:885:class_export_put()) final put ffff959c4177c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789048660.687683:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c4177c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1789048660.687688:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789048660.687780:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2023d000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1789048660.687785:0:36:0:(genops.c:885:class_export_put()) final put ffff959c2ac89800/lustre-MDD0000_UUID 00000020:00000080:2.0:1789048660.687786:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2ac89800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1789048660.687791:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000100:00100000:1.0:1789048660.687923:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.687935:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.687941:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.687947:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.687965:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.687971:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.687976:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.687983:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.687989:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.687995:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688000:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688006:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688012:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688018:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688023:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688030:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688035:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688040:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688045:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688051:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688057:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688063:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688069:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688074:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688081:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688087:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688094:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688099:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688104:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688110:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688115:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688122:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688127:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789048660.688128:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2023b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1789048660.688132:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688138:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789048660.688139:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c33592000/17f7b908-b8ce-4c14-97e3-2e83ca6f061b for MGS 00000100:00100000:1.0:1789048660.688143:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688148:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688154:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688159:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789048660.688168:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c33597000 for MGS 00000100:00100000:1.0:1789048660.688170:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688175:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688180:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688186:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688191:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688196:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688202:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688207:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688213:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688219:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688225:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688230:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688235:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688241:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688245:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688251:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688256:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688261:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688266:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688271:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688277:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688282:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688287:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688291:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048660.688296:0:15132:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1789048660.703885:0:15132:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff959b07a0fcc0 - data ffff959b0600b288/ffff959b07814c00 00000020:01000000:1.0:1789048660.704131:0:15132:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff959c02e35cc0 - data ffff959c390291b0/ffff959c32ec6000 00000020:00000080:1.0:1789048660.704586:0:15132:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c087758f9 00000020:00000080:1.0:1789048660.704594:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c11567800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789048660.704610:0:15132:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959c335d0800 from MGS, refs=2 00000020:01000004:1.0:1789048660.704620:0:15132:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c335d0800 2 00000020:01000004:1.0:1789048660.704623:0:15132:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff959c335d0800 from MGS 00000020:00000080:2.0:1789048660.704793:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff959c11567800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789048660.704821:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789048660.704828:0:15132:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789048660.704840:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c11561800/MGS 00000020:00000080:1.0:1789048660.704842:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff959c11561800/MGS for MGS 00000020:01000000:1.0:1789048660.704848:0:15132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789048660.704906:0:15132:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789048660.704910:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789048660.704915:0:15132:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789048660.704921:0:15132:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff959c3d2f4000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789048660.704927:0:15132:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff959c20a00000) has exports, disconnecting them 00000020:00080000:1.0:1789048660.704931:0:15132:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff959c3d2f4000), last request at 1789048395 00000020:00000080:1.0:1789048660.704935:0:15132:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c087759c4 00000020:00080000:1.0:1789048660.704944:0:15132:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959c3d2f4000): rc 0 00000020:00000080:1.0:1789048660.704947:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c3d2f4000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789048660.708980:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3d2f4000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1789048660.710164:0:15132:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1789048660.710171:0:15132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789048660.710176:0:15132:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789048660.710184:0:15132:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789048660.710211:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c3d2f1000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789048660.710405:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789048660.710414:0:15132:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789048660.710419:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c3d2f4800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789048660.710423:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3d2f4800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789048660.710432:0:15132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1789048660.710528:0:15132:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c335d0800 1 00000020:00000080:2.0:1789048660.710546:0:15132:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c087758eb 00000020:00000080:2.0:1789048660.710552:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c11560000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1789048660.710562:0:15132:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1789048660.710581:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff959c11560000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789048660.710591:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789048660.710605:0:15132:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789048660.710609:0:15132:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff959c39458000) has no exports 00000020:00000080:0.0:1789048660.829170:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789048660.829182:0:15132:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789048660.829188:0:15132:0:(genops.c:885:class_export_put()) final put ffff959c335d6000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789048660.829194:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff959c335d6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789048660.829205:0:15132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789048660.829320:0:15132:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff959c335d1800 00000020:02000400:0.0:1789048660.829400:0:15132:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789048660.967213:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048661.984186:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048663.005612:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048664.030427:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789048664.541538:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789048664.541545:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789048664.541549:0:8:0:(import.c:65:import_set_state_nolock()) ffff959c41788000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789048664.541557:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 414 00000100:00080000:0.0:1789048664.541563:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789048664.541586:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff959c41788000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048664.541609:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080db480 x1875953111437568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789048664.541624:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789048664.541627:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789048664.541641:0:8:0:(import.c:65:import_set_state_nolock()) ffff959c3e9df800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789048664.541645:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 414 00000100:00080000:0.0:1789048664.541648:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789048664.541653:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff959c3e9df800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048664.541666:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080d9880 x1875953111437696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789048664.541675:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789048664.541678:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789048664.541680:0:8:0:(import.c:65:import_set_state_nolock()) ffff959c3e9dc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789048664.541683:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 414 00000100:00080000:0.0:1789048664.541685:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789048664.541689:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff959c3e9dc800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048664.541699:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080da680 x1875953111437824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789048664.541723:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789048664.541726:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789048664.541727:0:8:0:(import.c:65:import_set_state_nolock()) ffff959b0758e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789048664.541730:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 414 00000100:00080000:0.0:1789048664.541732:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789048664.541736:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff959b0758e800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048664.541745:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080d9c00 x1875953111438208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048664.541994:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111437440:0@lo:400:kworker.0 00000400:00000100:3.0:1789048664.542045:0:3621:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875953111437440 offset 0 length 224: 4 00000100:00100000:3.0:1789048664.542112:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111438464:0@lo:400:kworker.0 00000100:00100000:3.0:1789048664.542146:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048664.542175:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789048664.542180:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111438336:0@lo:400:kworker.0 00000100:00100000:3.0:1789048664.542202:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048664.542327:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111438464 00000100:00100000:3.0:1789048664.542356:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111438464 00000100:00100000:3.0:1789048664.542407:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789048664.542416:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111438464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048664.542465:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111438464:12345-0@lo:400:kworker.0 Request processed in 50us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048664.542472:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789048664.542495:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111438336 00000100:00100000:3.0:1789048664.542499:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111438336 00000100:00100000:3.0:1789048664.542537:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1789048664.542545:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111438336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048664.542590:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111438336:12345-0@lo:400:kworker.0 Request processed in 46us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048664.542595:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00010000:00080000:3.0:1789048664.542637:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff959b080d9f80 x1875953111438336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048664.542650:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111438336:0@lo:400:kworker.0 00000100:00100000:3.0:1789048664.542662:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111438464:0@lo:400:kworker.0 00000100:00100000:2.0:1789048664.542831:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111437568:0@lo:38:kworker.0 00000100:00100000:2.0:1789048664.542875:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048664.542898:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875953111437696:0@lo:38:kworker.0 00000100:00100000:2.0:1789048664.542921:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048664.542939:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111437824:0@lo:38:kworker.0 00000100:00100000:2.0:1789048664.542960:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048664.542984:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111438208:0@lo:38:kworker.0 00000100:00100000:2.0:1789048664.543006:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048664.543038:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111437952:0@lo:400:kworker.0 00000100:00100000:2.0:1789048664.543064:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048664.543083:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789048664.543089:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111438080:0@lo:400:kworker.0 00000100:00100000:2.0:1789048664.543108:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789048664.543138:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789048664.543143:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789048664.543153:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111438080 00000100:00100000:2.0:1789048664.543157:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111438080 00000100:00100000:2.0:1789048664.543189:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789048664.543196:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111438080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048664.543233:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111438080:12345-0@lo:400:kworker.0 Request processed in 38us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048664.543239:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789048664.543269:0:7806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111437568 00000100:00100000:2.0:1789048664.543272:0:7806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111437568 00000100:00100000:2.0:1789048664.543293:0:7806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789048664.543298:0:7806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3619:x1875953111437568:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789048664.543317:0:7806:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789048664.543376:0:7806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3619:x1875953111437568:12345-0@lo:38:kworker.0 Request processed in 76us (500us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789048664.543382:0:7806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789048664.543400:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111437696 00000100:00100000:2.0:1789048664.543403:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111437696 00000100:00100000:2.0:1789048664.543415:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111437824 00000100:00100000:2.0:1789048664.543424:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111437824 00000100:00100000:2.0:1789048664.543437:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111438208 00000100:00100000:2.0:1789048664.543439:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111438208 00000100:00100000:2.0:1789048664.543446:0:8649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111437952 00000100:00100000:2.0:1789048664.543448:0:8649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111437952 00000100:00100000:2.0:1789048664.543465:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789048664.543471:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111437952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048664.543502:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111437952:12345-0@lo:400:kworker.0 Request processed in 32us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048664.543508:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789048664.543520:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789048664.543523:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1875953111437696:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789048664.543551:0:8649:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789048664.543910:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1875953111437696:12345-0@lo:38:kworker.0 Request processed in 50us (654us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789048664.543919:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789048664.543934:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789048664.543938:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1875953111437824:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789048664.543948:0:8649:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789048664.543974:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1875953111437824:12345-0@lo:38:kworker.0 Request processed in 34us (1013us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789048664.543979:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789048664.543990:0:8649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789048664.543994:0:8649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1875953111438208:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789048664.544003:0:8649:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789048664.544026:0:8649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1875953111438208:12345-0@lo:38:kworker.0 Request processed in 31us (1019us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789048664.544039:0:8649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:2.0:1789048664.544075:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789048664.544079:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048664.544110:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111438080:0@lo:400:kworker.0 00010000:00080000:2.0:1789048664.544122:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff959b080d9180 x1875953111437952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048664.544132:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111437952:0@lo:400:kworker.0 00000100:00080000:2.0:1789048664.544168:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c41788000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048664.544172:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789048664.544176:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111437568:0@lo:38:kworker.0 00000100:00080000:2.0:1789048664.544184:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3e9df800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048664.544187:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789048664.544190:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875953111437696:0@lo:38:kworker.0 00000100:00080000:2.0:1789048664.544197:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3e9dc800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048664.544200:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789048664.544203:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111437824:0@lo:38:kworker.0 00000100:00080000:2.0:1789048664.544211:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b0758e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048664.544214:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789048664.544216:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111438208:0@lo:38:kworker.0 00000100:00100000:3.0:1789048664.545556:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789048664.545572:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111438592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048664.545634:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048664.545674:0:10080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111438592 00000100:00100000:3.0:1789048664.545682:0:10080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111438592 00000100:00100000:3.0:1789048664.545725:0:10080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789048664.545733:0:10080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111438592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789048664.545760:0:10080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789048664.545798:0:10080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111438592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048664.545805:0:10080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789048664.545844:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111438592:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789048665.053758:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789048665.468317:0:15334:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789048665.491395:0:15334:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1789048665.491572:0:15334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c013d6800/0x133f221c08775e47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e4e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048665.491588:0:15334:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c013d6800/0x133f221c08775e47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775e4e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048665.491609:0:15334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c013d6800/0x133f221c08775e47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775e4e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048665.491617:0:15334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c013d6800/0x133f221c08775e47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775e4e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048665.491639:0:15334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789048665.491644:0:15334:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789048665.491671:0:15334:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:1.0:1789048665.491672:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789048665.491676:0:15334:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:1.0:1789048665.491680:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c013d6800/0x133f221c08775e47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775e4e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789048665.491681:0:15334:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789048665.491687:0:15334:0:(import.c:65:import_set_state_nolock()) ffff959c3e9df800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:1.0:1789048665.491687:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c013d6800 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048665.491691:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c013d6800/0x133f221c08775e47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775e4e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789048665.491692:0:15334:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789048665.491694:0:15334:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789048665.491696:0:15334:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789048665.491699:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c013d6800/0x133f221c08775e47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08775e4e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048665.491707:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c013d6800/0x133f221c08775e47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08775e4e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048665.491712:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789048665.491714:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789048665.491722:0:6485:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789048665.491760:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c013d6800/0x133f221c08775e47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775e4e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048665.491767:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048665.491793:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c013d6800/0x133f221c08775e47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775e4e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048665.491800:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c013d6800/0x133f221c08775e47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775e4e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048665.491812:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048665.491813:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048665.491815:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048665.492571:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789048665.492592:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111438720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789048665.492668:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048665.492814:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111438720 00000100:00100000:1.0:1789048665.492821:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111438720 00000100:00100000:1.0:1789048665.492866:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789048665.492873:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3622:x1875953111438720:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789048665.492879:0:6482:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789048665 with bad export cookie 1386864714049870101 00010000:00010000:2.0:1789048665.493222:0:15334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02836200/0x133f221c08775e55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e5c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048665.493234:0:15334:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02836200/0x133f221c08775e55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775e5c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048665.493242:0:15334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02836200/0x133f221c08775e55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775e5c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048665.493250:0:15334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c02836200/0x133f221c08775e55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775e5c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048665.493302:0:15334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048665.493316:0:15334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d000/0x133f221c08775d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775d36 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048665.493324:0:15334:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d000/0x133f221c08775d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775d36 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048665.493355:0:15334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d000/0x133f221c08775d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775d36 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048665.493363:0:15334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d000/0x133f221c08775d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775d36 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.498328:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789048665.498368:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c02836200/0x133f221c08775e55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775e5c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.498390:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836200 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:0.0:1789048665.498396:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c02836200/0x133f221c08775e55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775e5c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.498408:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c02836200/0x133f221c08775e55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08775e5c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048665.498416:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c02836200/0x133f221c08775e55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08775e5c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048665.498422:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789048665.498425:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1789048665.498649:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c02836200/0x133f221c08775e55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775e5c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.498656:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789048665.498693:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c02836200/0x133f221c08775e55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775e5c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.498700:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c02836200/0x133f221c08775e55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775e5c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.498714:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048665.498718:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d000/0x133f221c08775d2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775d36 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.498740:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d000 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:0.0:1789048665.498743:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d000/0x133f221c08775d2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775d36 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.498750:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d000/0x133f221c08775d2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08775d36 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048665.498755:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d000/0x133f221c08775d2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08775d36 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048665.498760:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789048665.498762:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1789048665.498775:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d000/0x133f221c08775d2f lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775d36 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.498780:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789048665.498786:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d000/0x133f221c08775d2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775d36 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.498793:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048665.498795:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048665.498796:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048665.498859:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111438848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048665.498945:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048665.499001:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789048665.499008:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111438976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048665.499033:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048665.499071:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111438848 00000100:00100000:3.0:1789048665.499078:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111438848 00000100:00100000:3.0:1789048665.499109:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111438976 00000100:00100000:3.0:1789048665.499112:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111438976 00000100:00100000:3.0:1789048665.499125:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789048665.499141:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04fea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3620:x1875953111438848:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789048665.499148:0:6481:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789048665 with bad export cookie 1386864714049870101 00000100:00100000:3.0:1789048665.499189:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04fea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3620:x1875953111438848:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (244us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789048665.499195:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789048665.499212:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789048665.499216:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3620:x1875953111438976:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789048665.499220:0:6481:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789048665 with bad export cookie 1386864714049870101 00000100:00100000:3.0:1789048665.499243:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3620:x1875953111438976:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (210us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789048665.499248:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789048665.499280:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.116@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789048665.499284:0:3620:0:(import.c:65:import_set_state_nolock()) ffff959c048a3000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1789048665.499288:0:3620:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1789048665.501672:0:15334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789048665.501686:0:15334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d000/0x133f221c08775d2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775d36 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048665.501711:0:15334:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789048665.501790:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048665.501806:0:15334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ce00/0x133f221c087760cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087760d2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.501815:0:15334:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ce00/0x133f221c087760cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087760d2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.501823:0:15334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ce00/0x133f221c087760cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c087760d2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.501847:0:15334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ce00/0x133f221c087760cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c087760d2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048665.502171:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048665.502179:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ce00/0x133f221c087760cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c087760d2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048665.502188:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3ce00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048665.502192:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ce00/0x133f221c087760cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c087760d2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048665.502201:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ce00/0x133f221c087760cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c087760d2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048665.502209:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ce00/0x133f221c087760cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c087760d2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048665.502226:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789048665.502228:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1789048665.502259:0:15334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789048665.502264:0:15334:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789048665.502271:0:15334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00031e00/0x133f221c08775a18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775a1f expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.502279:0:15334:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00031e00/0x133f221c08775a18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775a1f expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.502285:0:15334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c00031e00/0x133f221c08775a18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775a1f expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.502292:0:15334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c00031e00/0x133f221c08775a18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775a1f expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.502306:0:15334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789048665.502309:0:15334:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1789048665.502312:0:15334:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:0.0:1789048665.502381:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048665.502386:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c00031e00/0x133f221c08775a18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775a1f expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.502393:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c00031e00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:0.0:1789048665.502396:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c00031e00/0x133f221c08775a18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775a1f expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.502402:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c00031e00/0x133f221c08775a18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08775a1f expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048665.502415:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c00031e00/0x133f221c08775a18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08775a1f expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048665.502421:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789048665.502423:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789048665.502425:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:1.0:1789048665.507108:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3622:x1875953111438720:12345-0@lo:103:ldlm_bl.0 Request processed in 14227us (14433us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789048665.507122:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789048665.507233:0:3622:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.116@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789048665.530928:0:3620:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.116@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1789048665.530933:0:3620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789048665.530943:0:3620:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b080db100 x1875953111437440/t0(0) o400->MGC192.168.202.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789048680 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048665.530971:0:3620:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959c3fb9ca80 x1875953111438720/t0(0) o103->MGC192.168.202.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789048681 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048665.530982:0:3620:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b080da680 x1875953111438848/t0(0) o103->MGC192.168.202.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789048681 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048665.530993:0:3620:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b080d9880 x1875953111438976/t0(0) o103->MGC192.168.202.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789048681 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789048665.531002:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789048665.531004:0:3620:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789048665.531006:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:2.0:1789048665.531576:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ce00/0x133f221c087760cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c087760d2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048665.531588:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048665.531612:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ce00/0x133f221c087760cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c087760d2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048665.531619:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ce00/0x133f221c087760cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c087760d2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048665.531636:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048665.531638:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048665.531641:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048665.531655:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789048665.531673:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:0:1875953111439104:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789048665.531817:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c00031e00/0x133f221c08775a18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775a1f expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.531825:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789048665.531846:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c00031e00/0x133f221c08775a18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775a1f expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.531853:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c00031e00/0x133f221c08775a18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08775a1f expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048665.531868:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048665.531870:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048665.531872:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789048665.531902:0:15334:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1789048665.531906:0:15334:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1789048665.531911:0:15334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789048665.531916:0:15334:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1789048665.531921:0:15334:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff959c3fb22800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789048665.531926:0:15334:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff959b06839000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789048665.531931:0:15334:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff959c394b99c0) has exports, disconnecting them 00000020:00080000:0.0:1789048665.531935:0:15334:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff959c3fb22800), last request at 1789048664 00000020:00000080:0.0:1789048665.531941:0:15334:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775cf7 00000100:00080000:0.0:1789048665.531958:0:15334:0:(import.c:65:import_set_state_nolock()) ffff959c3fb21800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789048665.532002:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789048665.532015:0:15334:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959c3fb22800): rc 0 00000020:00000080:0.0:1789048665.532017:0:15334:0:(genops.c:885:class_export_put()) final put ffff959c3fb22800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1789048665.532027:0:15334:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff959b06839000), last request at 1789048664 00000020:00000080:0.0:1789048665.532030:0:15334:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775bd1 00000100:00080000:0.0:1789048665.532035:0:15334:0:(import.c:65:import_set_state_nolock()) ffff959b06838800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1789048665.532046:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3fb22800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1789048665.532086:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c3fb21800 for lustre-MDT0001 00000020:00080000:0.0:1789048665.532103:0:15334:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959b06839000): rc 0 00000020:00000080:0.0:1789048665.532105:0:15334:0:(genops.c:885:class_export_put()) final put ffff959b06839000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1789048665.532114:0:15334:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb770c0d4bae0 00000020:00000080:0.0:1789048665.532124:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff959b06839000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1789048665.532147:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b06838800 for lustre-MDT0001 00000100:00080000:0.0:1789048665.532166:0:15334:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789048665.532170:0:15334:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1789048665.533124:0:15334:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789048665.533132:0:15334:0:(import.c:65:import_set_state_nolock()) ffff959c41788000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789048665.533276:0:15334:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789048665.533280:0:15334:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1789048665.533302:0:15334:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789048665.533388:0:15334:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789048665.533407:0:15334:0:(import.c:65:import_set_state_nolock()) ffff959b0683b000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789048665.533420:0:15334:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789048665.533423:0:15334:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:0.0:1789048665.533504:0:15334:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789048665.533665:0:15334:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789048665.533676:0:15334:0:(import.c:65:import_set_state_nolock()) ffff959c3fb24000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789048665.533699:0:15334:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff959c394b99c0) has no exports 00010000:00010000:2.0:1789048665.533946:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048665.533962:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111439360:0@lo:9:umount.0 00000100:00100000:2.0:1789048665.534026:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048665.534063:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111439488:0@lo:9:umount.0 00000100:00100000:2.0:1789048665.534082:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048665.534147:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111439360 00000100:00100000:2.0:1789048665.534154:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111439360 00000100:00100000:2.0:1789048665.534192:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111439488 00000100:00100000:2.0:1789048665.534195:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111439488 00000100:00100000:2.0:1789048665.534213:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789048665.534220:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875953111439360:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789048665.534250:0:8412:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775c1e 00000100:00080000:2.0:1789048665.534257:0:8412:0:(import.c:65:import_set_state_nolock()) ffff959c416dd000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789048665.534295:0:8412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1789048665.534554:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789048665.534564:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875953111439488:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789048665.534645:0:8413:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775d6e 00000100:00080000:0.0:1789048665.534652:0:8413:0:(import.c:65:import_set_state_nolock()) ffff959c3fb26800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789048665.534681:0:8413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789048665.534767:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3619:x1875953111439488:12345-0@lo:9:umount.0 Request processed in 204us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048665.534774:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:0.0:1789048665.534793:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048665.534830:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3619:x1875953111439360:12345-0@lo:9:umount.0 Request processed in 610us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048665.534838:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:2.0:1789048665.534858:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789048665.534882:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b0683b000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789048665.534887:0:3619:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789048665.534890:0:3619:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789048665.534893:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111439360:0@lo:9:umount.0 00000100:00080000:2.0:1789048665.534901:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3fb24000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789048665.534904:0:3619:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789048665.534906:0:3619:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789048665.534908:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111439488:0@lo:9:umount.0 00000100:00100000:2.0:1789048665.534931:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:0:1875953111439232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048665.535931:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3621:1875953111437440:0@lo:400:kworker.0 00000100:00080000:1.0:1789048665.536167:0:3622:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff959c048a3000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:3.0:1789048665.536168:0:3620:0:(import.c:65:import_set_state_nolock()) ffff959c048a3000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789048665.536174:0:3620:0:(import.c:545:import_select_connection()) MGC192.168.202.116@tcp: connect to NID 0@lo last attempt 149 00000100:00080000:3.0:1789048665.536184:0:3620:0:(import.c:666:import_select_connection()) MGC192.168.202.116@tcp: import ffff959c048a3000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048665.536189:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3622:1875953111438720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048665.536218:0:3620:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b08846300 x1875953111439616/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789048665.536265:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3619:1875953111439616:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1789048665.536296:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875953111439616 offset 0 length 520: 4 00000100:00100000:3.0:1789048665.536390:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111438848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048665.536405:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3620:1875953111438976:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1789048665.544952:0:15334:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff959c394b99c0) has no exports 00000020:01000000:2.0:1789048665.622996:0:15334:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff959b07a0fba0 - data ffff959b06089948/ffff959c41557800 00000020:01000000:2.0:1789048665.623144:0:15334:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff959c3d3df5a0 - data ffff959c391bad80/ffff959c4150e000 00000001:00000004:2.0:1789048665.656193:0:15334:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1789048665.707002:0:15334:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789048665.707011:0:15334:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1789048665.707020:0:15334:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789048665.723886:0:15334:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789048665.723895:0:15334:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1789048665.723925:0:15334:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789048665.723928:0:15334:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789048665.724528:0:8791:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789048665.724534:0:8791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1789048665.724544:0:8791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789048665.725135:0:15334:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789048665.725140:0:15334:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1789048665.725158:0:15334:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789048665.725161:0:15334:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789048665.726131:0:9892:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789048665.726151:0:9892:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1789048665.726163:0:9892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789048665.728827:0:15334:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775a3b 00000020:00000080:3.0:1789048665.728839:0:15334:0:(genops.c:885:class_export_put()) final put ffff959c4178f000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789048665.729499:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c4178f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789048665.734398:0:15334:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775a50 00000020:00000080:3.0:1789048665.734414:0:15334:0:(genops.c:885:class_export_put()) final put ffff959c4178b000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789048665.734423:0:15334:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1789048665.734428:0:15334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789048665.734435:0:15334:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789048665.734440:0:15334:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff959c394bcd40) has no exports 00000004:01000000:3.0:1789048665.734653:0:15334:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789048665.734662:0:15334:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775d59 00000020:00000080:3.0:1789048665.734675:0:15334:0:(genops.c:885:class_export_put()) final put ffff959c3fb25000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789048665.734680:0:15334:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789048665.734682:0:15334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789048665.734690:0:15334:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789048665.734692:0:15334:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff959b077e8000) has no exports 00000020:00000080:3.0:1789048665.734698:0:15334:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775d52 00000020:00000080:3.0:1789048665.734701:0:15334:0:(genops.c:885:class_export_put()) final put ffff959c3fb21000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1789048665.735034:0:15334:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789048665.735039:0:15334:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789048665.735043:0:15334:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1789048665.735049:0:15334:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789048665.735051:0:15334:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789048665.735082:0:15334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789048665.735090:0:15334:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789048665.735096:0:15334:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775c17 00000020:00000080:3.0:1789048665.735100:0:15334:0:(genops.c:885:class_export_put()) final put ffff959c416da000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789048665.735104:0:15334:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789048665.735107:0:15334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789048665.735111:0:15334:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789048665.735113:0:15334:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff959c3ef7b380) has no exports 00000020:00000080:3.0:1789048665.735117:0:15334:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775c10 00000020:00000080:3.0:1789048665.735120:0:15334:0:(genops.c:885:class_export_put()) final put ffff959b0683d000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1789048665.735449:0:15334:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789048665.735452:0:15334:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789048665.735454:0:15334:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1789048665.735457:0:15334:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789048665.735459:0:15334:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789048665.735503:0:15334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789048665.735509:0:15334:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1789048665.735531:0:15334:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789048665.735536:0:15334:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775a73 00000020:00000080:3.0:1789048665.735541:0:15334:0:(genops.c:885:class_export_put()) final put ffff959c4177f000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789048665.735554:0:15334:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1789048665.735557:0:15334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789048665.735561:0:15334:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789048665.735563:0:15334:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff959c3e8819c0) has no exports 00000020:00000080:3.0:1789048665.735567:0:15334:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775a6c 00000020:00000080:3.0:1789048665.735571:0:15334:0:(genops.c:885:class_export_put()) final put ffff959c3e83f000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789048665.737013:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c4178b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1789048665.737029:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3fb25000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789048665.737035:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3fb21000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789048665.737040:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c3fb24000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789048665.737050:0:37:0:(genops.c:885:class_export_put()) final put ffff959c3fb20800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789048665.737052:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3fb20800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789048665.737056:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789048665.737138:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c416da000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789048665.737143:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959b0683d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789048665.737147:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b0683b000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789048665.737150:0:37:0:(genops.c:885:class_export_put()) final put ffff959b0683f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789048665.737152:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959b0683f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789048665.737157:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789048665.737184:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c4177f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789048665.737188:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3e83f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789048665.739414:0:15334:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1789048665.739423:0:15334:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789048665.739428:0:15334:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1789048665.739438:0:15334:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789048665.739511:0:15334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789048665.739532:0:15334:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789048665.739600:0:15334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789048665.739612:0:15334:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789048665.739618:0:15334:0:(genops.c:885:class_export_put()) final put ffff959c08ade800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789048665.739622:0:15334:0:(genops.c:844:class_export_destroy()) destroying export ffff959c08ade800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1789048665.739634:0:15334:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789048665.739796:0:15334:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775a57 00000020:00000080:2.0:1789048665.739803:0:15334:0:(genops.c:885:class_export_put()) final put ffff959c4178d800/lustre-MDD0001_UUID 00000020:01000000:2.0:1789048665.739808:0:15334:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1789048665.739812:0:15334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789048665.739816:0:15334:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789048665.739819:0:15334:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff959c394b8000) has no exports 00000020:00000080:2.0:1789048665.739845:0:15334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789048665.739850:0:15334:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1789048665.739854:0:15334:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775a5e 00000020:00000080:2.0:1789048665.739859:0:15334:0:(genops.c:885:class_export_put()) final put ffff959c4178a800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1789048665.739866:0:15334:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959c414c7000 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1789048665.739869:0:15334:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c414c7000 2 00000020:01000004:2.0:1789048665.739872:0:15334:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff959c414c7000 from lustre-MDT0001 00000020:00000080:2.0:1789048665.739888:0:15334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789048665.739892:0:15334:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1789048665.739895:0:15334:0:(genops.c:885:class_export_put()) final put ffff959c4178e800/lustre-MDT0001_UUID 00000020:00000080:2.0:1789048665.739897:0:15334:0:(genops.c:844:class_export_destroy()) destroying export ffff959c4178e800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1789048665.739904:0:15334:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1789048665.739946:0:15334:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1789048665.739958:0:15334:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1789048665.739961:0:15334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789048665.739965:0:15334:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789048665.739972:0:15334:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff959c3e9df000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789048665.739977:0:15334:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff959c3e880000) has exports, disconnecting them 00000020:00080000:2.0:1789048665.739982:0:15334:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff959c3e9df000), last request at 1789048414 00000020:00000080:2.0:1789048665.739985:0:15334:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775ab2 00000020:00080000:2.0:1789048665.740001:0:15334:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959c3e9df000): rc 0 00000020:00000080:2.0:1789048665.740004:0:15334:0:(genops.c:885:class_export_put()) final put ffff959c3e9df000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789048665.742235:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c41788000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789048665.742274:0:37:0:(genops.c:885:class_export_put()) final put ffff959c3e83d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789048665.742277:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3e83d800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1789048665.742284:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789048665.742439:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c4178d800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1789048665.742444:0:37:0:(genops.c:885:class_export_put()) final put ffff959c4178c000/lustre-MDD0001_UUID 00000020:00000080:0.0:1789048665.742445:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c4178c000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1789048665.742449:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1789048665.742631:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c4178a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789048665.742637:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3e9df000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1789048665.745448:0:15334:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1789048665.745458:0:15334:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789048665.745464:0:15334:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789048665.745473:0:15334:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789048665.745499:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c3e9df800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789048665.745687:0:15334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789048665.745697:0:15334:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1789048665.745702:0:15334:0:(genops.c:885:class_export_put()) final put ffff959c3e9be000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1789048665.745706:0:15334:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3e9be000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1789048665.745714:0:15334:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1789048665.745778:0:15334:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c414c7000 1 00000020:00000080:0.0:1789048665.745784:0:15334:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c087759ee 00000020:00000080:0.0:1789048665.745791:0:15334:0:(genops.c:885:class_export_put()) final put ffff959c3d2f6000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1789048665.745799:0:15334:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1789048665.745807:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3d2f6000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789048665.745816:0:15334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789048665.745821:0:15334:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789048665.745824:0:15334:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff959c20a03380) has no exports 00000020:00000080:0.0:1789048665.818262:0:15334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789048665.818275:0:15334:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1789048665.818293:0:15334:0:(genops.c:885:class_export_put()) final put ffff959c414c4800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789048665.818298:0:15334:0:(genops.c:844:class_export_destroy()) destroying export ffff959c414c4800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1789048665.818310:0:15334:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1789048665.818441:0:15334:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff959c414c2000 00000020:01000000:0.0:1789048665.818464:0:15334:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789048665.818469:0:15334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789048665.818473:0:15334:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789048665.818477:0:15334:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff959c3945b380) has no exports 00000100:00100000:2.0:1789048665.820035:0:8649:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff959b05d42e00:8649] 3 exiting: rc = 0 00000100:00100000:2.0:1789048665.820162:0:12131:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff959c415e1400:12131] 4 exiting: rc = 0 00000100:00100000:2.0:1789048665.820235:0:6497:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff959c3c47f200:6497] 0 exiting: rc = 1 00000100:00100000:0.0:1789048665.820388:0:6498:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff959c3c47ea00:6498] 1 exiting: rc = 0 00000100:00100000:0.0:1789048665.820466:0:6499:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff959c10760200:6499] 2 exiting: rc = 0 00000100:00100000:0.0:1789048665.820538:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820549:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820555:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820560:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820802:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820809:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820814:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820820:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820826:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820831:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820835:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820839:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820842:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820845:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820849:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820853:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820856:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820860:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820863:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820868:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820871:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820876:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820883:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820889:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820911:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820916:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820922:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820928:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820933:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820938:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820944:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820950:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820956:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820962:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820968:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820974:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820979:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820984:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820989:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.820995:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821003:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821008:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821013:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821019:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821024:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821029:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821036:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821041:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821048:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821054:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821060:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821067:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821073:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821078:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821084:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821090:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821095:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821100:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821105:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821118:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821123:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821129:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821135:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.821141:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048665.825726:0:6501:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff959c04955800:6501] 1 exiting: rc = 0 00000100:00100000:3.0:1789048665.825872:0:6500:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff959c14e8b200:6500] 0 exiting: rc = 1 00000100:00100000:0.0:1789048665.826131:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826139:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826143:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826148:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826152:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826156:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826162:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826166:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826171:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826174:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826178:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826183:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826187:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826191:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826195:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826199:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826203:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826206:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826210:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826213:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826216:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826219:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826222:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826225:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826228:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826231:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826234:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826237:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826248:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826252:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826266:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826271:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826275:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826280:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826284:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826288:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826292:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826295:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826299:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826303:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826306:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826310:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826313:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826316:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826319:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826322:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826325:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826328:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826463:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826470:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826473:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826476:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826479:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826482:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826485:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826489:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826492:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826495:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826498:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826501:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826504:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826507:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826510:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.826523:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048665.827058:0:6502:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff959c37fbc400:6502] 0 exiting: rc = 1 00000100:00100000:2.0:1789048665.827143:0:7806:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff959c3eb38200:7806] 2 exiting: rc = 0 00000100:00100000:2.0:1789048665.827309:0:6503:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff959c04affe00:6503] 1 exiting: rc = 0 00000100:00100000:0.0:1789048665.827549:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827638:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827658:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827665:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827673:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827681:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827686:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827693:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827699:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827705:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827713:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827718:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827725:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827739:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827746:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827751:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827763:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827769:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827782:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827793:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827856:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827871:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827889:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827904:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827910:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827936:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827943:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827949:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827955:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827961:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827966:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827972:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827978:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827985:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827990:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.827995:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828013:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828066:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828073:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828079:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828084:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828090:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828096:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828103:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828110:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828116:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828121:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828126:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828132:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828150:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828157:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828162:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828167:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828172:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828178:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828183:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828188:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828194:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828199:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828208:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828220:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828227:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828232:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.828413:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048665.836859:0:6504:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff959c04afe400:6504] 0 exiting: rc = 1 00000100:00100000:3.0:1789048665.836976:0:6505:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff959c04afe000:6505] 1 exiting: rc = 0 00000100:00100000:0.0:1789048665.837117:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837125:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837130:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837135:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837140:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837145:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837150:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837166:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837171:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837176:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837181:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837186:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837191:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837195:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837200:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837205:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837210:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837214:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837219:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837224:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837229:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837234:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837408:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837418:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837424:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837429:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837434:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837439:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837444:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837449:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837453:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837458:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837462:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837466:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837471:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837476:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837481:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837486:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837491:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837495:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837500:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837504:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837524:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837529:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837533:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837539:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837544:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837549:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837554:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837559:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837625:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837632:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837636:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837641:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837645:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837650:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837655:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837659:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837665:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837671:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837676:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837681:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837686:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.837691:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048665.838144:0:6507:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff959c04aff400:6507] 1 exiting: rc = 0 00000100:00100000:3.0:1789048665.838372:0:6506:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff959c04aff000:6506] 0 exiting: rc = 1 00000100:00100000:0.0:1789048665.838482:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838488:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838493:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838497:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838502:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838506:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838511:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838526:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838532:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838537:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838543:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838549:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838553:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838639:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838645:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838650:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838655:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838659:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838664:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838669:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838674:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838678:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838682:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838687:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838692:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838704:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838709:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838760:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838765:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838770:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838774:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838779:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838783:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838788:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838792:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838796:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838801:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838806:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838811:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838816:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838821:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838826:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838830:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838834:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838839:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838844:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838849:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838853:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838864:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838869:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838873:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838877:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838882:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838886:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838891:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838896:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838901:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838913:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838918:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838923:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838927:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838932:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838936:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.838975:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048665.839648:0:6509:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff959c04949a00:6509] 1 exiting: rc = 0 00000100:00100000:2.0:1789048665.839788:0:6508:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff959c10771200:6508] 0 exiting: rc = 1 00000100:00100000:0.0:1789048665.839927:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.839935:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.839940:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.839945:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.839949:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.839954:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.839959:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.839963:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.839968:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.839972:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.839977:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.839982:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.839987:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.839991:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.839995:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840000:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840005:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840009:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840014:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840026:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840031:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840036:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840040:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840045:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840049:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840054:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840058:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840063:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840068:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840079:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840084:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840089:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840093:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840098:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840103:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840108:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840113:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840117:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840121:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840125:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840130:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840134:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840138:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840142:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840182:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840188:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840192:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840196:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840200:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840205:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840209:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840214:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840218:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840222:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840233:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840237:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840309:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840315:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840320:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840324:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840329:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840438:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840443:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.840448:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048665.841166:0:6510:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff959c2ae8a800:6510] 0 exiting: rc = 1 00000100:00100000:3.0:1789048665.841704:0:6511:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff959c2ae8ba00:6511] 1 exiting: rc = 0 00000100:00100000:3.0:1789048665.841871:0:6512:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff959c10771a00:6512] 2 exiting: rc = 0 00000100:00100000:0.0:1789048665.841993:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842000:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842005:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842011:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842016:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842021:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842026:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842031:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842036:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842042:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842047:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842052:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842068:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842074:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842079:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842084:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842089:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842094:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842100:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842106:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842111:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842117:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842127:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842135:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842140:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842205:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842210:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842216:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842222:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842227:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842233:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842238:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842317:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842322:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842328:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842422:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842444:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842451:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842458:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842463:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842470:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842476:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842482:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842488:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842494:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842500:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842505:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842510:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842525:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842532:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842538:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842544:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842550:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842555:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842560:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842646:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842651:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842657:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842663:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842667:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842681:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842687:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842692:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048665.842698:0:15334:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789048665.847215:0:15334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789048665.847234:0:15334:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789048665.847396:0:15334:0:(genops.c:885:class_export_put()) final put ffff959c37fcb800/MDS_uuid 00000020:00000080:0.0:1789048665.847402:0:15334:0:(genops.c:844:class_export_destroy()) destroying export ffff959c37fcb800/MDS_uuid for MDS 00000020:01000000:0.0:1789048665.847407:0:15334:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789048665.847555:0:15334:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1789048666.084687:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048667.105582:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048668.128664:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048669.150657:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789048669.661539:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 17f7b908-b8ce-4c14-97e3-2e83ca6f061b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789048669.661548:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 17f7b908-b8ce-4c14-97e3-2e83ca6f061b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789048669.661551:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789048669.661555:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789048669.661559:0:36:0:(import.c:65:import_set_state_nolock()) ffff959c3e9dc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048669.661575:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 419 00000100:00080000:2.0:1789048669.661590:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789048669.661602:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff959c3e9dc800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048669.661637:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c08a8c000 x1875953111439744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789048669.661675:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789048669.661678:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789048669.661680:0:36:0:(import.c:65:import_set_state_nolock()) ffff959b0758e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048669.661684:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 419 00000100:00080000:2.0:1789048669.661686:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789048669.661691:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff959b0758e800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048669.661702:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c08a8c380 x1875953111440000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789048669.661735:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111439744:0@lo:38:kworker.0 00000400:00000100:2.0:1789048669.661786:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875953111439744 offset 0 length 520: 4 00000100:00100000:1.0:1789048669.662365:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111440128:0@lo:400:kworker.0 00000400:00000100:1.0:1789048669.662391:0:3621:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875953111440128 offset 0 length 224: 4 00000100:00100000:1.0:1789048669.662431:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789048669.662446:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111439872:0@lo:400:kworker.0 00000400:00000100:1.0:1789048669.662464:0:3621:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875953111439872 offset 0 length 224: 4 00000100:00100000:2.0:1789048669.662594:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111440000:0@lo:38:kworker.0 00000400:00000100:2.0:1789048669.662615:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875953111440000 offset 0 length 520: 4 00010000:00010000:2.0:1789048670.174078:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789048670.500143:0:15535:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789048670.527531:0:15535:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789048670.527587:0:15535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c420cd000/0x133f221c08775e2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e32 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048670.527616:0:15535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c420cd000/0x133f221c08775e2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775e32 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048670.527624:0:15535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c420cd000/0x133f221c08775e2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775e32 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048670.527632:0:15535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c420cd000/0x133f221c08775e2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775e32 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048670.527652:0:15535:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789048670.527658:0:15535:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789048670.527682:0:15535:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789048670.527694:0:15535:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959c08a8c000 x1875953111439744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789048689 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048670.527724:0:15535:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789048670.527731:0:15535:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789048670.527738:0:15535:0:(import.c:65:import_set_state_nolock()) ffff959c3e9dc800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789048670.527743:0:15535:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789048670.527747:0:15535:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959c08a8c000 x1875953111439744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789048689 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048670.527755:0:15535:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789048670.527758:0:15535:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:3.0:1789048670.528122:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111439744:0@lo:38:kworker.0 00010000:00010000:2.0:1789048670.528433:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048670.528441:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c420cd000/0x133f221c08775e2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775e32 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048670.528450:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c420cd000 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048670.528454:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c420cd000/0x133f221c08775e2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775e32 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048670.528463:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c420cd000/0x133f221c08775e2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08775e32 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048670.528492:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c420cd000/0x133f221c08775e2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08775e32 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048670.528497:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789048670.528500:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789048670.528503:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789048670.528516:0:6484:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff959c048a3000 00010000:00010000:2.0:1789048670.528520:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c420cd000/0x133f221c08775e2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c08775e32 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048670.528528:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c420cd000/0x133f221c08775e2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c08775e32 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048670.528540:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048670.528542:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048670.528544:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789048670.531511:0:15535:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789048670.531530:0:15535:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959c08a8df80 x1875953111439872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048685 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048670.531555:0:15535:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789048670.531562:0:15535:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789048670.531588:0:15535:0:(import.c:65:import_set_state_nolock()) ffff959b06838000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789048670.531666:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3619:1875953111440256:0@lo:39:umount.0 00000400:00000100:2.0:1789048670.531726:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875953111440256 offset 0 length 224: 4 00000100:00100000:1.0:1789048670.531923:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111439872:0@lo:400:kworker.0 00000100:00080000:0.0:1789048670.685719:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 17f7b908-b8ce-4c14-97e3-2e83ca6f061b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789048670.685730:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 17f7b908-b8ce-4c14-97e3-2e83ca6f061b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789048670.685734:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789048670.685737:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789048670.685872:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111440384:0@lo:400:kworker.0 00000400:00000100:2.0:1789048670.685931:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875953111440384 offset 0 length 224: 4 00010000:00010000:0.0:1789048671.199541:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789048671.201246:0:9492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789048671.201255:0:9492:0:(genops.c:885:class_export_put()) final put ffff959c3fb27000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789048671.201371:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3fb27000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789048671.201422:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c3fb26800 for lustre-OST0001 00000001:00100000:1.0:1789048671.201684:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789048671.201688:0:8407:0:(genops.c:885:class_export_put()) final put ffff959c416dc800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789048671.202649:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c416dc800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789048671.207998:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c416dd000 for lustre-OST0000 00010000:00010000:0.0:1789048672.226446:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048673.247051:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048674.270204:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789048674.717623:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 17f7b908-b8ce-4c14-97e3-2e83ca6f061b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789048674.717633:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 17f7b908-b8ce-4c14-97e3-2e83ca6f061b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789048674.717637:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789048674.717641:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789048674.717839:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111440512:0@lo:400:kworker.0 00000400:00000100:2.0:1789048674.717909:0:3623:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875953111440512 offset 0 length 224: 4 00010000:00010000:0.0:1789048675.297558:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048675.677879:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048665/real 1789048665] req@ffff959b08846300 x1875953111439616/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789048675 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048675.677916:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959b08846300 x1875953111439616/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789048675 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789048675.677958:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c048a3000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048675.678006:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789048675.678010:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3619:1875953111439616:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1789048675.678922:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 17f7b908-b8ce-4c14-97e3-2e83ca6f061b->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789048675.678928:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789048675.678940:0:36:0:(import.c:65:import_set_state_nolock()) ffff959c048a3000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789048675.678946:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.116@tcp: connect to NID 0@lo last attempt 420 00000100:00080000:3.0:1789048675.678951:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.116@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789048675.678962:0:36:0:(import.c:666:import_select_connection()) MGC192.168.202.116@tcp: import ffff959c048a3000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048675.678992:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b08846d80 x1875953111440640/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789048675.679030:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789048675.679034:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789048675.679211:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111440768:0@lo:400:kworker.0 00000400:00000100:1.0:1789048675.679258:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875953111440768 offset 0 length 224: 4 00000100:00100000:2.0:1789048675.679909:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3619:1875953111440640:0@lo:250:kworker.0 00000400:00000100:2.0:1789048675.679937:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875953111440640 offset 0 length 520: 4 00010000:00010000:0.0:1789048676.317950:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048677.341625:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048678.365553:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048679.392766:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048680.416311:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048680.799413:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048670/real 1789048670] req@ffff959b08844380 x1875953111440256/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789048680 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048680.799450:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959b08844380 x1875953111440256/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789048680 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789048680.799477:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b06838000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789048680.799503:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3619:1875953111440256:0@lo:39:umount.0 00000100:00080000:0.0:1789048680.799765:0:15535:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789048680.799787:0:15535:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789048680.799792:0:15535:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789048680.800737:0:15535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c420cd200/0x133f221c08775e39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e40 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048680.800753:0:15535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c420cd200/0x133f221c08775e39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775e40 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048680.800762:0:15535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c420cd200/0x133f221c08775e39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775e40 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048680.800769:0:15535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c420cd200/0x133f221c08775e39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775e40 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048680.800802:0:15535:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789048680.800810:0:15535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c200/0x133f221c087760bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087760c4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048680.800817:0:15535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c200/0x133f221c087760bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087760c4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048680.800824:0:15535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c200/0x133f221c087760bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c087760c4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048680.800831:0:15535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c200/0x133f221c087760bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c087760c4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048680.800843:0:15535:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789048680.800847:0:15535:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789048680.800871:0:15535:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789048680.800875:0:15535:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789048680.800888:0:15535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789048680.800894:0:15535:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789048680.800898:0:15535:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff959c03e44d40) has no exports 00000020:00080000:0.0:1789048680.800924:0:15535:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff959c03e44d40) has no exports 00000020:01000000:0.0:1789048680.802642:0:15535:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff959c3e934de0 - data ffff959c392c2798/ffff959c3edffc00 00000020:01000000:0.0:1789048680.802764:0:15535:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff959b01c03c00 - data ffff959c392c4ca8/ffff959c3edf4800 00010000:00010000:1.0:1789048680.803518:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789048680.803530:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c420cd200/0x133f221c08775e39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775e40 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048680.803542:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c420cd200 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048680.803546:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c420cd200/0x133f221c08775e39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775e40 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048680.803557:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c420cd200/0x133f221c08775e39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08775e40 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048680.803565:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c420cd200/0x133f221c08775e39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08775e40 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048680.803572:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789048680.803575:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789048680.803578:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789048680.803594:0:6484:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff959c048a3000 00010000:00010000:1.0:1789048680.803599:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c420cd200/0x133f221c08775e39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c08775e40 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048680.803606:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c420cd200/0x133f221c08775e39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c08775e40 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048680.803637:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048680.803641:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c200/0x133f221c087760bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c087760c4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048680.803646:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c200 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048680.803649:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c200/0x133f221c087760bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c087760c4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048680.803657:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c200/0x133f221c087760bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c087760c4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048680.803663:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c200/0x133f221c087760bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c087760c4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048680.803668:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789048680.803671:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789048680.803673:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789048680.803679:0:6484:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff959c048a3000 00010000:00010000:1.0:1789048680.803682:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c200/0x133f221c087760bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c087760c4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048680.803689:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c200/0x133f221c087760bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c087760c4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048680.803697:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048680.803699:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048680.803701:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048680.811097:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1789048680.846261:0:15535:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789048680.856255:0:15535:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775b8b 00000020:00000080:2.0:1789048680.856267:0:15535:0:(genops.c:885:class_export_put()) final put ffff959c08adb000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789048680.856432:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c08adb000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:2.0:1789048680.856461:0:15535:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959c41779800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789048680.856465:0:15535:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c41779800 2 00000020:01000004:2.0:1789048680.856468:0:15535:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff959c41779800 from lustre-OST0000 00000020:00000080:2.0:1789048680.856494:0:15535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789048680.856618:0:15535:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789048680.856622:0:15535:0:(genops.c:885:class_export_put()) final put ffff959c2ac8b800/lustre-OST0000_UUID 00000020:00000080:2.0:1789048680.856625:0:15535:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2ac8b800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789048680.856704:0:15535:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789048680.856756:0:15535:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789048680.856761:0:15535:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789048680.856764:0:15535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789048680.856770:0:15535:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789048680.856777:0:15535:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff959b06954000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789048680.856783:0:15535:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff959c2022cd40) has exports, disconnecting them 00000020:00080000:2.0:1789048680.856788:0:15535:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff959b06954000), last request at 1789048437 00000020:00000080:2.0:1789048680.856792:0:15535:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775bb5 00000020:00080000:2.0:1789048680.856802:0:15535:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959b06954000): rc 0 00000020:00000080:2.0:1789048680.856808:0:15535:0:(genops.c:885:class_export_put()) final put ffff959b06954000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789048680.856845:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b06954000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789048680.881274:0:15535:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789048680.881721:0:15535:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789048680.881727:0:15535:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789048680.881736:0:15535:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789048680.881937:0:15535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789048680.881948:0:15535:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1789048680.881954:0:15535:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789048680.881958:0:15535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789048680.881962:0:15535:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789048680.881969:0:15535:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff959b0683c000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789048680.881976:0:15535:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff959c3ef78000) has exports, disconnecting them 00000020:00080000:2.0:1789048680.881980:0:15535:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff959b0683c000), last request at 1789048437 00000020:00000080:2.0:1789048680.882167:0:15535:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775bca 00000020:00080000:2.0:1789048680.882180:0:15535:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959b0683c000): rc 0 00000020:00000080:2.0:1789048680.882187:0:15535:0:(genops.c:885:class_export_put()) final put ffff959b0683c000/lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1789048680.883272:0:15535:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000020:00000080:3.0:1789048680.883538:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c3e9dc800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789048680.883551:0:36:0:(genops.c:885:class_export_put()) final put ffff959c2effb000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789048680.883555:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2effb000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789048680.883579:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789048680.883653:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b0683c000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00000100:00080000:2.0:1789048680.883754:0:15535:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789048680.883758:0:15535:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789048680.883763:0:15535:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789048680.883945:0:15535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789048680.883952:0:15535:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1789048680.883958:0:15535:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c41779800 1 00000020:00000080:2.0:1789048680.883963:0:15535:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775b53 00000020:00000080:2.0:1789048680.883970:0:15535:0:(genops.c:885:class_export_put()) final put ffff959c3eb75800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789048680.883974:0:15535:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789048680.883978:0:15535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789048680.883982:0:15535:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789048680.884064:0:15535:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff959c03e43380) has no exports 00000020:00000080:3.0:1789048680.887915:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b06838000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789048680.887931:0:36:0:(genops.c:885:class_export_put()) final put ffff959b0683a000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1789048680.887934:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b0683a000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1789048680.887952:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1789048680.888018:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3eb75800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000100:00080000:3.0:1789048680.925912:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 17f7b908-b8ce-4c14-97e3-2e83ca6f061b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789048680.925921:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 17f7b908-b8ce-4c14-97e3-2e83ca6f061b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789048680.925924:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789048680.925927:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789048680.930390:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111440896:0@lo:400:kworker.0 00000400:00000100:0.0:1789048680.930469:0:3621:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875953111440896 offset 0 length 224: 4 00000020:00000080:2.0:1789048680.983064:0:15535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789048680.983080:0:15535:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789048680.983089:0:15535:0:(genops.c:885:class_export_put()) final put ffff959c20238800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789048680.983104:0:15535:0:(genops.c:844:class_export_destroy()) destroying export ffff959c20238800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789048680.983115:0:15535:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789048680.983227:0:15535:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff959c4177c000 00000020:02000400:2.0:1789048680.983273:0:15535:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789048681.438390:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048682.462400:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048683.502584:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048684.511000:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1789048685.025361:0:3621:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048669/real 1789048669] req@ffff959c08a8d180 x1875953111440128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789048685 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048685.049439:0:3621:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff959c08a8d180 x1875953111440128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789048685 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789048685.049454:0:3621:0:(import.c:65:import_set_state_nolock()) ffff959b07588000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789048685.049458:0:3621:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789048685.075944:0:3621:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1789048685.080819:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 17f7b908-b8ce-4c14-97e3-2e83ca6f061b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789048685.080829:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 17f7b908-b8ce-4c14-97e3-2e83ca6f061b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789048685.080832:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789048685.080835:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789048685.080837:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789048685.080840:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789048685.080845:0:37:0:(import.c:65:import_set_state_nolock()) ffff959b07588000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789048685.080853:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 215 00000100:00080000:1.0:1789048685.080869:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff959b07588000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048685.080906:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fb9ca80 x1875953111441024/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789048685.080963:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111440128:0@lo:400:kworker.0 00000100:00100000:2.0:1789048685.081040:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3619:1875953111441024:0@lo:38:kworker.0 00000400:00000100:2.0:1789048685.081091:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875953111441024 offset 0 length 520: 4 00010000:00010000:1.0:1789048685.535742:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789048685.852135:0:15737:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789048685.866639:0:15737:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1789048685.866724:0:15737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d400/0x133f221c08775e0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048685.866738:0:15737:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d400/0x133f221c08775e0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775e16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048685.866745:0:15737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d400/0x133f221c08775e0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775e16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048685.866752:0:15737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d400/0x133f221c08775e0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775e16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048685.866824:0:15737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789048685.866831:0:15737:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789048685.869522:0:15737:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789048685.869540:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959c08a8c380 x1875953111440000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789048689 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048685.869566:0:15737:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789048685.869573:0:15737:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789048685.869580:0:15737:0:(import.c:65:import_set_state_nolock()) ffff959b0758e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789048685.869586:0:15737:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789048685.869590:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959c08a8c380 x1875953111440000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789048689 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048685.869597:0:15737:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789048685.869600:0:15737:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:3.0:1789048685.869746:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111440000:0@lo:38:kworker.0 00000100:00080000:2.0:1789048685.870894:0:15737:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789048685.870904:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b080d8700 x1875953111440384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048686 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048685.870969:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b08844000 x1875953111440512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048690 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048685.870986:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b08845c00 x1875953111440768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048691 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048685.870999:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b08844380 x1875953111440896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048696 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048685.871033:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959c3fb9ca80 x1875953111441024/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789048695 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048685.871042:0:15737:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789048685.871047:0:15737:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789048685.871052:0:15737:0:(import.c:65:import_set_state_nolock()) ffff959b07588000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789048685.871056:0:15737:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789048685.871060:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b080d8700 x1875953111440384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048686 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048685.871130:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111440512:0@lo:400:kworker.0 00010000:00010000:0.0:1789048685.872546:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048685.872560:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d400/0x133f221c08775e0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775e16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048685.872574:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d400 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:0.0:1789048685.872579:0:7447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d400/0x133f221c08775e0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775e16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048685.872590:0:7447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d400/0x133f221c08775e0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08775e16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048685.872614:0:7447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d400/0x133f221c08775e0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08775e16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048685.872622:0:7447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789048685.872625:0:7447:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789048685.872629:0:7447:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789048685.872645:0:7447:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff959c048a3000 00010000:00010000:0.0:1789048685.872649:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d400/0x133f221c08775e0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c08775e16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048685.872656:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d400/0x133f221c08775e0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c08775e16 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048685.872745:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111440896:0@lo:400:kworker.0 00000100:00100000:1.0:1789048685.872898:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111440384:0@lo:400:kworker.0 00000100:00100000:2.0:1789048685.872966:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b08844000 x1875953111440512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048690 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048685.872979:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b08845c00 x1875953111440768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048691 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048685.872988:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b08844380 x1875953111440896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048696 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048685.872997:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959c3fb9ca80 x1875953111441024/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789048695 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048685.873007:0:15737:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789048685.873084:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111440768:0@lo:400:kworker.0 00000100:00100000:3.0:1789048685.873104:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3619:1875953111441024:0@lo:38:kworker.0 00010000:00010000:3.0:1789048685.876520:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048685.876527:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048685.876529:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048685.879996:0:15737:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789048685.881689:0:15737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775e1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08775e24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048685.881708:0:15737:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775e1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08775e24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048685.881718:0:15737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775e1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775e24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048685.881725:0:15737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775e1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08775e24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048685.881749:0:15737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789048685.881757:0:15737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba1a00/0x133f221c087760af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087760b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048685.881764:0:15737:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba1a00/0x133f221c087760af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087760b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048685.881770:0:15737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba1a00/0x133f221c087760af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c087760b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048685.881776:0:15737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959b07ba1a00/0x133f221c087760af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c087760b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048685.881843:0:15737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789048685.881849:0:15737:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789048685.881886:0:15737:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789048685.881890:0:15737:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789048685.881903:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789048685.881909:0:15737:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789048685.881913:0:15737:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff959c20228000) has no exports 00000020:00080000:3.0:1789048685.881937:0:15737:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff959c20228000) has no exports 00000020:01000000:3.0:1789048685.884619:0:15737:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff959b07a0f6c0 - data ffff959c1103f6c0/ffff959c41556800 00000020:01000000:3.0:1789048685.884791:0:15737:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff959b01c034e0 - data ffff959c393425e8/ffff959b07b1f800 00010000:00010000:1.0:1789048685.885003:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789048685.885015:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775e1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775e24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048685.885026:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c013d7800 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048685.885031:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775e1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08775e24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048685.885041:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775e1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08775e24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048685.885068:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775e1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08775e24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048685.885075:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789048685.885078:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1789048685.885082:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1789048685.885099:0:6484:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff959c048a3000 00010000:00010000:1.0:1789048685.885103:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775e1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c08775e24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048685.885110:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c013d7800/0x133f221c08775e1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c08775e24 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048685.885121:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048685.885125:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959b07ba1a00/0x133f221c087760af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c087760b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048685.885132:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1a00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048685.885135:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959b07ba1a00/0x133f221c087760af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c087760b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048685.885142:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959b07ba1a00/0x133f221c087760af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c087760b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048685.885149:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959b07ba1a00/0x133f221c087760af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c087760b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048685.885155:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789048685.885157:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789048685.885164:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789048685.885169:0:6484:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff959c048a3000 00010000:00010000:1.0:1789048685.885172:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959b07ba1a00/0x133f221c087760af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c087760b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048685.885177:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959b07ba1a00/0x133f221c087760af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c087760b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048685.885188:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048685.885190:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048685.885192:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048685.885252:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789048685.899102:0:15737:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789048685.918742:0:15737:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775cb1 00000020:00000080:0.0:1789048685.918755:0:15737:0:(genops.c:885:class_export_put()) final put ffff959b06b53800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789048685.918771:0:15737:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959b06952000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789048685.918775:0:15737:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959b06952000 2 00000020:01000004:0.0:1789048685.918778:0:15737:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff959b06952000 from lustre-OST0001 00000020:00000080:0.0:1789048685.918804:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789048685.918814:0:15737:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789048685.918817:0:15737:0:(genops.c:885:class_export_put()) final put ffff959b06b57800/lustre-OST0001_UUID 00000020:00000080:0.0:1789048685.918819:0:15737:0:(genops.c:844:class_export_destroy()) destroying export ffff959b06b57800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789048685.918826:0:15737:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789048685.918932:0:15737:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 17f7b908-b8ce-4c14-97e3-2e83ca6f061b->MGS 00010000:00010000:0.0:1789048685.918951:0:15737:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c00030600/0x133f221c08775a0a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08775a11 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048685.918978:0:15737:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c00030600/0x133f221c08775a0a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08775a11 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048685.918984:0:15737:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789048685.918987:0:15737:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789048685.918991:0:15737:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789048685.919005:0:15737:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff959c048a3000 00010000:00010000:0.0:1789048685.919009:0:15737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c00030600/0x133f221c08775a0a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c08775a11 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048685.919025:0:15737:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c420cc200/0x133f221c08775e7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08775e86 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048685.919032:0:15737:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c420cc200/0x133f221c08775e7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08775e86 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048685.919037:0:15737:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789048685.919040:0:15737:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789048685.919041:0:15737:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789048685.919056:0:15737:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff959c048a3000 00010000:00010000:0.0:1789048685.919059:0:15737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c420cc200/0x133f221c08775e7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c08775e86 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789048685.919077:0:15737:0:(import.c:65:import_set_state_nolock()) ffff959c048a3000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789048685.919081:0:15737:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789048685.919083:0:15737:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789048685.919085:0:15737:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789048685.919089:0:15737:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789048685.919100:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b08846d80 x1875953111440640/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789048690 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789048685.919139:0:15737:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789048685.919142:0:15737:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:1.0:1789048685.919291:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17f7b908-b8ce-4c14-97e3-2e83ca6f061b:3619:1875953111440640:0@lo:250:kworker.0 10000000:01000000:0.0:1789048685.919360:0:15737:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789048685.919367:0:15737:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775907 00000020:00000080:2.0:1789048685.919484:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959b06b53800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789048685.919564:0:15737:0:(genops.c:885:class_export_put()) final put ffff959c37fcf000/17f7b908-b8ce-4c14-97e3-2e83ca6f061b 00000020:01000000:0.0:1789048685.919579:0:15737:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.116@tcp (flags='') 00000020:00000080:0.0:1789048685.919586:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789048685.919591:0:15737:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.116@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789048685.919597:0:15737:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff959c394bb380) has no exports 10000000:01000000:1.0:1789048685.919932:0:6494:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:2.0:1789048685.920485:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c37fcf000/17f7b908-b8ce-4c14-97e3-2e83ca6f061b for MGC192.168.202.116@tcp 10000000:01000000:0.0:1789048685.920659:0:15737:0:(obd_class.h:676:obd_cleanup_client_import()) MGC192.168.202.116@tcp: client import never connected 00000100:00080000:0.0:1789048685.920663:0:15737:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789048685.920666:0:15737:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789048685.920669:0:15737:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789048685.920671:0:15737:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789048685.920716:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789048685.920724:0:15737:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.116@tcp (uuid 17f7b908-b8ce-4c14-97e3-2e83ca6f061b) 00000020:01000000:0.0:1789048685.920730:0:15737:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789048685.920733:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789048685.920737:0:15737:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789048685.920742:0:15737:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff959b0758f000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789048685.920747:0:15737:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff959c3ef7cd40) has exports, disconnecting them 00000020:00080000:0.0:1789048685.920751:0:15737:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff959b0758f000), last request at 1789048461 00000020:00000080:0.0:1789048685.920755:0:15737:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775cdb 00000020:00080000:0.0:1789048685.920767:0:15737:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959b0758f000): rc 0 00000020:00000080:0.0:1789048685.920772:0:15737:0:(genops.c:885:class_export_put()) final put ffff959b0758f000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789048685.921567:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c048a3000 for MGC192.168.202.116@tcp 00000020:00000080:2.0:1789048685.921577:0:37:0:(genops.c:885:class_export_put()) final put ffff959c048a2800/17f7b908-b8ce-4c14-97e3-2e83ca6f061b 00000020:00000080:2.0:1789048685.921579:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c048a2800/17f7b908-b8ce-4c14-97e3-2e83ca6f061b for MGC192.168.202.116@tcp 00000020:01000000:2.0:1789048685.921584:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.116@tcp (17f7b908-b8ce-4c14-97e3-2e83ca6f061b) 00000020:00000080:2.0:1789048685.921838:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959b0758f000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789048685.923762:0:15737:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789048685.923770:0:15737:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789048685.923774:0:15737:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789048685.923780:0:15737:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789048685.923992:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789048685.924000:0:15737:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1789048685.924006:0:15737:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789048685.924011:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789048685.924014:0:15737:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789048685.924021:0:15737:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff959b0758e000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789048685.924027:0:15737:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff959b079219c0) has exports, disconnecting them 00000020:00080000:0.0:1789048685.924031:0:15737:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff959b0758e000), last request at 1789048461 00000020:00000080:0.0:1789048685.924035:0:15737:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775cf0 00000020:00080000:0.0:1789048685.924049:0:15737:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959b0758e000): rc 0 00000020:00000080:0.0:1789048685.924053:0:15737:0:(genops.c:885:class_export_put()) final put ffff959b0758e000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1789048685.928329:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b0758e800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789048685.928365:0:37:0:(genops.c:885:class_export_put()) final put ffff959b0758d800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1789048685.928375:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959b0758d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1789048685.928385:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1789048685.930108:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959b0758e000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1789048685.930636:0:15737:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789048685.930641:0:15737:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789048685.930645:0:15737:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789048685.930651:0:15737:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789048685.930672:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b07588000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1789048685.933973:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789048685.935032:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789048685.936594:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1789048685.936864:0:8428:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff959b05d40200:8428] 2 exiting: rc = 0 00000100:00100000:2.0:1789048685.936927:0:6479:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff959c10760400:6479] 0 exiting: rc = 1 00000100:00100000:1.0:1789048685.940764:0:6480:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff959c18eca000:6480] 1 exiting: rc = 0 00000100:00100000:2.0:1789048685.941156:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048685.942117:0:13167:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff959b0825aa00:13167] 3 exiting: rc = 0 00000100:00100000:2.0:1789048685.942597:0:6483:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff959c052a7200:6483] 2 exiting: rc = 0 00000100:00100000:3.0:1789048685.942773:0:6481:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff959c10761a00:6481] 0 exiting: rc = 1 00000100:00100000:2.0:1789048685.944481:0:6482:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff959c10761400:6482] 1 exiting: rc = 0 00000100:00100000:2.0:1789048685.944590:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944598:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944604:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944610:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944616:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944623:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944630:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944636:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944643:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944651:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944656:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944662:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944668:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944680:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944687:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944707:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944712:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944718:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944725:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944733:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944740:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944746:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944751:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944757:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944763:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944768:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944774:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944780:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944785:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944790:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944796:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944802:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944808:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944814:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944818:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944824:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944829:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944834:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944844:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944850:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944855:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944861:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944866:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944871:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944877:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944882:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944887:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944893:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944898:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944902:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944915:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944921:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944926:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944932:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944937:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944943:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944948:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944954:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944959:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944964:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944970:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944975:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944980:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048685.944986:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789048685.962585:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789048685.962603:0:15737:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1789048685.962608:0:15737:0:(genops.c:885:class_export_put()) final put ffff959b0758b000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1789048685.962613:0:15737:0:(genops.c:844:class_export_destroy()) destroying export ffff959b0758b000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1789048685.962619:0:15737:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1789048685.962672:0:15737:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959b06952000 1 00000020:00000080:2.0:1789048685.962678:0:15737:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08775c80 00000020:00000080:2.0:1789048685.962684:0:15737:0:(genops.c:885:class_export_put()) final put ffff959c3fb26000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789048685.962695:0:15737:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789048685.962706:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3fb26000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789048685.962720:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789048685.962725:0:15737:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789048685.962728:0:15737:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff959c202299c0) has no exports 00000020:00000080:2.0:1789048686.148631:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789048686.148645:0:15737:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789048686.148651:0:15737:0:(genops.c:885:class_export_put()) final put ffff959c3e83c800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789048686.148655:0:15737:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3e83c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789048686.148663:0:15737:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789048686.148949:0:15737:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff959b06955000 00000020:01000000:2.0:1789048686.148978:0:15737:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789048686.148981:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789048686.148985:0:15737:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789048686.148989:0:15737:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff959c3ef799c0) has no exports 00000020:00000080:2.0:1789048686.149016:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789048686.149021:0:15737:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789048686.149024:0:15737:0:(genops.c:885:class_export_put()) final put ffff959c3eb72800/OSS_uuid 00000020:00000080:2.0:1789048686.149026:0:15737:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3eb72800/OSS_uuid for OSS 00000020:01000000:2.0:1789048686.149029:0:15737:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1789048686.149277:0:6493:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789048686.149512:0:8412:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff959c3ebb6c00:8412] 0 exiting: rc = 1 00000100:00100000:1.0:1789048686.149622:0:8414:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff959c18778a00:8414] 2 exiting: rc = 0 00000100:00100000:2.0:1789048686.149837:0:8804:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff959b05d73400:8804] 3 exiting: rc = 0 00000100:00100000:0.0:1789048686.150180:0:8413:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff959c18778c00:8413] 1 exiting: rc = 0 00000100:00100000:2.0:1789048686.150276:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150284:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150297:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150305:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150311:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150462:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150470:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150476:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150481:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150486:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150491:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150496:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150502:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150507:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150514:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150519:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150524:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150528:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150533:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150539:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150543:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150548:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150552:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150557:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150562:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150580:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150584:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150589:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150594:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150599:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150607:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150612:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150629:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150634:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150639:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150645:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150650:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150655:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150659:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150664:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150669:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150674:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150680:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150685:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150690:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150695:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150700:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150706:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150712:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150717:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150722:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150729:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150734:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150740:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150745:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150752:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150757:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150762:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150768:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150773:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150788:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150794:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150804:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.150812:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048686.152546:0:10080:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff959c415e0400:10080] 2 exiting: rc = 0 00000100:00100000:0.0:1789048686.152752:0:8415:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff959c37fbaa00:8415] 0 exiting: rc = 1 00000100:00100000:1.0:1789048686.152846:0:8416:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff959c41529e00:8416] 1 exiting: rc = 0 00000100:00100000:2.0:1789048686.153051:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153062:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153070:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153076:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153081:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153086:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153091:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153097:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153102:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153108:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153114:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153119:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153125:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153130:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153135:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153142:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153147:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153152:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153157:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153162:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153167:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153172:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153178:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153184:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153190:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153195:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153200:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153205:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153210:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153215:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153221:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153237:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153242:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153247:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153251:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153257:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153262:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153267:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153273:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153278:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153283:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153289:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153294:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153300:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153304:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153309:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153314:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153329:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153515:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153521:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153526:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153532:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153538:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153543:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153549:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153555:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153560:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153565:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153571:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153576:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153581:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153587:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153592:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.153604:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.154897:0:8419:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff959c3ebb0e00:8419] 2 exiting: rc = 0 00000100:00100000:2.0:1789048686.155074:0:8418:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff959c3ebb1200:8418] 1 exiting: rc = 0 00000100:00100000:3.0:1789048686.155254:0:8417:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff959c18ecba00:8417] 0 exiting: rc = 1 00000100:00100000:2.0:1789048686.155404:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155411:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155418:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155424:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155430:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155436:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155441:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155447:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155453:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155458:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155464:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155469:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155474:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155480:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155485:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155491:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155509:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155515:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155520:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155525:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155531:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155536:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155542:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155548:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155553:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155558:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155564:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155569:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155574:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155580:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155586:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155591:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155597:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155603:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155608:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155622:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155627:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155634:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155641:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155647:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155666:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155674:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155680:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155686:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155692:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155698:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155704:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155711:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155717:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155722:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155729:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155734:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155740:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155745:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155752:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155757:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155763:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155777:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155784:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155789:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155795:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155801:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155816:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.155823:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048686.162438:0:8420:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff959c3ebb1a00:8420] 0 exiting: rc = 1 00000100:00100000:1.0:1789048686.162532:0:8421:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff959c3ebb1600:8421] 1 exiting: rc = 0 00000100:00100000:2.0:1789048686.164945:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.164956:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.164961:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.164967:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.164972:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.164977:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165002:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165015:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165023:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165028:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165033:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165040:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165045:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165051:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165056:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165061:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165067:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165072:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165078:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165084:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165089:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165095:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165101:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165107:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165859:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165870:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165875:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165891:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165897:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165902:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165907:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165912:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165918:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165923:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165928:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165934:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165939:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165945:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165950:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165956:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165961:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165975:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165981:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165987:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165992:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.165997:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.166003:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.166008:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.166014:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.166019:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.166024:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.166030:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.166035:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.166040:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.166045:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.166051:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.166057:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.166062:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.166067:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.166073:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.166079:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.166084:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.166090:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.166095:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.166915:0:8423:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff959c414f9a00:8423] 1 exiting: rc = 0 00000100:00100000:1.0:1789048686.167291:0:8422:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff959c414f8e00:8422] 0 exiting: rc = 1 00000100:00100000:2.0:1789048686.167529:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167537:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167544:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167551:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167556:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167581:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167588:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167595:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167600:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167606:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167611:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167629:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167634:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167640:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167645:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167651:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167657:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167676:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167683:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167689:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167695:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167700:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167705:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167711:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167717:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167722:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167728:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167733:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167739:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167760:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167767:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167774:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167780:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167786:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167792:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167798:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167803:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167808:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167814:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167820:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167825:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167845:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167852:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167858:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167864:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167869:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167890:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167896:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167902:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167907:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167913:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167919:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167924:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167943:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167949:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167955:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167960:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167966:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167971:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167976:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167981:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167986:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.167991:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048686.168002:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789048686.190302:0:15737:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789048709.008609:0:16500:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789048721.837669:0:17101:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789048721.837677:0:17101:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1789048721.837679:0:17101:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789048721.837805:0:17101:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff959c04ca4000 00000020:01000004:1.0:1789048721.837819:0:17101:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789048721.837826:0:17101:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789048721.837841:0:17101:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff959c202299c0) 00000020:00000080:1.0:1789048721.837853:0:17101:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789048721.929994:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1789048721.934807:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789048721.937027:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1789048721.943000:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1789048721.944544:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1789048721.945105:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1789048721.945459:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1789048721.946856:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1789048721.948772:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1789048721.949216:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1789048721.949735:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789048721.949986:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789048721.950508:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1789048721.950742:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1789048721.950990:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789048721.953371:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789048721.954123:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789048721.954515:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1789048721.955272:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789048721.955806:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1789048721.956601:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1789048721.957198:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1789048721.958734:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789048721.959715:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789048721.960012:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1789048721.960273:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789048721.961508:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1789048721.962114:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1789048721.962470:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1789048721.962702:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1789048721.964486:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1789048721.964962:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1789048721.965704:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789048721.966064:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789048721.966321:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1789048721.966632:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1789048721.967092:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789048721.967354:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1789048721.968159:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1789048721.968482:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789048721.968724:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789048721.969203:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1789048721.969509:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789048721.969741:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789048721.969986:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1789048721.971103:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1789048721.971486:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1789048721.974438:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789048721.975080:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1789048721.976480:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1789048721.978504:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1789048721.978829:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1789048721.979102:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:2.0:1789048721.979627:0:17101:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789048721.979831:0:17101:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789048721.979839:0:17101:0:(osd_handler.c:8921:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789048721.979850:0:17101:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c08776ebd 00000020:01000004:2.0:1789048721.979856:0:17101:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789048721.979862:0:17101:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789048721.979866:0:17101:0:(tgt_mount.c:101:server_register_mount()) register mount ffff959c04ca4000 from MGS 00000020:01000004:2.0:1789048721.979870:0:17101:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789048721.979887:0:17101:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff959b079219c0) 00000020:00000080:2.0:1789048721.979898:0:17101:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789048721.981236:0:17101:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c04ca4000 from MGS, refs=2 00080000:01000000:2.0:1789048721.981247:0:17101:0:(osd_handler.c:8921:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789048721.981257:0:17101:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c08776ecb 00000100:00100000:2.0:1789048721.981446:0:17101:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789048721.981578:0:17101:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789048721.981584:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789048721.987537:0:17101:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789048721.987556:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789048721.988445:0:17101:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789048721.988616:0:17101:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789048721.988622:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789048721.989643:0:17101:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789048721.989651:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789048721.990266:0:17101:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789048721.990274:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789048721.990938:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048721.990951:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048721.990953:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048721.991365:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048721.991367:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048721.991369:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048721.993618:0:17101:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789048721.997505:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789048722.002227:0:17101:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1789048722.013252:0:17114:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789048722.013329:0:17101:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789048722.013421:0:17101:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789048722.014326:0:17101:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789048722.014802:0:17101:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789048722.014968:0:17101:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789048722.014987:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789048722.018286:0:17101:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789048722.018310:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789048722.018867:0:17101:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789048722.018876:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789048722.022985:0:17101:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789048722.023014:0:17101:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.116@tcp' 00000020:01000004:1.0:1789048722.023016:0:17101:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789048722.023101:0:17101:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.116@tcp (typ=mgc) 00000020:00000080:1.0:1789048722.023112:0:17101:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.116@tcp (ffff959c20228000) 00000020:00000080:1.0:1789048722.023128:0:17101:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789048722.023285:0:17101:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959c04ca3800@MGC192.168.202.116@tcp: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1789048722.023567:0:17101:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.116@tcp-0 is initialized 00000040:01000000:1.0:1789048722.023574:0:17101:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789048722.024006:0:17118:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789048722.024172:0:17119:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789048722.024370:0:17101:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.116@tcp (uuid 41c76bec-8493-4b0e-a7d0-3ca4d71b9234) 00000020:00000080:3.0:1789048722.024387:0:17101:0:(genops.c:1384:class_connect()) connect: client 41c76bec-8493-4b0e-a7d0-3ca4d71b9234, cookie 0x133f221c08776ed9 00000100:00080000:3.0:1789048722.024397:0:17101:0:(import.c:545:import_select_connection()) MGC192.168.202.116@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789048722.024406:0:17101:0:(import.c:666:import_select_connection()) MGC192.168.202.116@tcp: import ffff959c04ca3800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048722.024436:0:17101:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b08845c00 x1875953111441152/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789048722.024455:0:17101:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 41c76bec-8493-4b0e-a7d0-3ca4d71b9234->MGS 00000020:01000004:3.0:1789048722.024479:0:17101:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789048722.024483:0:17101:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789048722.024493:0:17101:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff959b077eb380) 00000020:00000080:3.0:1789048722.024502:0:17101:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789048722.024637:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3619:1875953111441152:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789048722.024696:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048722.024829:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111441152 00000100:00100000:0.0:1789048722.024836:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111441152 00000100:00100000:0.0:1789048722.024868:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789048722.024876:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3619:x1875953111441152:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789048722.024899:0:17116:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 41c76bec-8493-4b0e-a7d0-3ca4d71b9234@0@lo t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:0.0:1789048722.024920:0:17116:0:(genops.c:1384:class_connect()) connect: client 41c76bec-8493-4b0e-a7d0-3ca4d71b9234, cookie 0x133f221c08776ee7 00000100:00080000:0.0:1789048722.025059:0:17116:0:(import.c:65:import_set_state_nolock()) ffff959b08017800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789048722.025111:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+5:3619:x1875953111441152:12345-0@lo:250:mount.lustre.0 Request processed in 234us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048722.025120:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789048722.025166:0:3619:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.116@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789048722.025173:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.116@tcp: connect to target with instance 0 00000100:00080000:0.0:1789048722.025179:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.116@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789048722.025183:0:3619:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789048722.025187:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c04ca3800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789048722.025189:0:3619:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789048722.025208:0:3619:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789048722.025213:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3619:1875953111441152:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789048722.049634:0:17101:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789048722.049832:0:17101:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789048722.049838:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789048722.052541:0:17101:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789048722.052554:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789048722.053027:0:17101:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789048722.053033:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789048722.053834:0:17101:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789048722.054121:0:17101:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789048722.054127:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789048722.061852:0:17101:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789048722.061865:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789048722.098224:0:17101:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789048722.098631:0:17101:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789048722.098638:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789048722.099675:0:17101:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789048722.099686:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789048722.100228:0:17101:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789048722.100592:0:17101:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789048722.100598:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789048722.101230:0:17101:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789048722.101237:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789048722.101840:0:17101:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789048722.102009:0:17101:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789048722.102014:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789048722.102752:0:17101:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789048722.102760:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789048722.103602:0:17101:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789048722.103752:0:17101:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789048722.103757:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789048722.104218:0:17101:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789048722.104224:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789048722.142404:0:17101:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789048722.142674:0:17101:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789048722.142681:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789048722.145266:0:17101:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789048722.145281:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789048722.146565:0:17101:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789048722.146575:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789048722.147894:0:17101:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789048722.147921:0:17101:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1789048722.147927:0:17101:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789048722.148107:0:17101:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789048722.148140:0:17101:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.116@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789048722.148145:0:17101:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789048722.148147:0:17101:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789048722.148148:0:17101:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048722.148149:0:17101:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048722.148150:0:17101:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048722.148151:0:17101:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048722.148153:0:17101:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789048722.148154:0:17101:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789048722.148156:0:17101:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048722.148157:0:17101:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789048722.148159:0:17101:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789048722.148161:0:17101:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789048722.148166:0:17101:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789048722.148168:0:17101:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048722.148169:0:17101:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048722.148170:0:17101:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048722.148171:0:17101:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048722.148172:0:17101:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789048722.148173:0:17101:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789048722.148174:0:17101:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048722.148175:0:17101:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789048722.148198:0:17101:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789048722.148216:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111441280:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789048722.148290:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048722.148590:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06000 going to sleep for 11 seconds 00000100:00100000:3.0:1789048722.148807:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111441280 00000100:00100000:3.0:1789048722.148814:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111441280 00000100:00100000:3.0:1789048722.148893:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789048722.148903:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+5:17101:x1875953111441280:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789048722.148943:0:17117:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789048722.148947:0:17117:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789048722.148949:0:17117:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789048722.149744:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789048722.150150:0:17117:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1789048722.152267:0:17139:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789048722.152275:0:17139:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1789048722.152279:0:17139:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789048722.152281:0:17139:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789048722.152691:0:17139:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1789048722.153226:0:17117:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789048722.153236:0:17117:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789048722.154957:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+5:17101:x1875953111441280:12345-0@lo:253:mount.lustre.0 Request processed in 6050us (6660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048722.154986:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789048722.155129:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111441280:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789048722.155145:0:17101:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789048722.155148:0:17101:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789048722.155150:0:17101:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789048722.155151:0:17101:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048722.155152:0:17101:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048722.155153:0:17101:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048722.155155:0:17101:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048722.155156:0:17101:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789048722.155158:0:17101:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789048722.155160:0:17101:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048722.155161:0:17101:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789048722.155179:0:17101:0:(tgt_mount.c:101:server_register_mount()) register mount ffff959c04ca4000 from lustre-MDT0000 10000000:01000000:0.0:1789048722.155212:0:17101:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789048722.155215:0:17101:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789048722.155219:0:17101:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff959c20228000 10000000:01000000:0.0:1789048722.155223:0:17101:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789048722.155230:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff959c20228000 from 1 10000000:01000000:0.0:1789048722.155232:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789048722.155267:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365600/0x133f221c08776eee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048722.155278:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b08365600/0x133f221c08776eee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048722.155287:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b08365600/0x133f221c08776eee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048722.155840:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080daa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111441408:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789048722.155883:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048722.155923:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c414b0180 going to sleep for 11 seconds 00000100:00100000:2.0:1789048722.155990:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111441408 00000100:00100000:2.0:1789048722.155998:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111441408 00000100:00100000:2.0:1789048722.156049:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789048722.156058:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+5:17101:x1875953111441408:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789048722.156072:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048722.156086:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c04cb1200/0x133f221c08776ef5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08776eee expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.156108:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c04cb1200/0x133f221c08776ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08776eee expref: 6 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.156118:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c04cb1200/0x133f221c08776ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08776eee expref: 6 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.156139:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb1200, rc 0) 00000100:00100000:2.0:1789048722.156215:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+6:17101:x1875953111441408:12345-0@lo:101:mount.lustre.0 Request processed in 158us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048722.156221:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789048722.156642:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080daa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111441408:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789048722.156658:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b08365600/0x133f221c08776eee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776ef5 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048722.156668:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b08365600/0x133f221c08776eee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08776ef5 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048722.156740:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111441536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048722.156767:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048722.156831:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c4153e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789048722.156871:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111441536 00000100:00100000:2.0:1789048722.156875:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111441536 00000100:00100000:2.0:1789048722.156938:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789048722.156946:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+6:17101:x1875953111441536:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048722.157039:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+6:17101:x1875953111441536:12345-0@lo:501:mount.lustre.0 Request processed in 93us (270us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789048722.157046:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789048722.157101:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111441536:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789048722.157127:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789048722.157146:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365600/0x133f221c08776eee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776ef5 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048722.157160:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b08365600/0x133f221c08776eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776ef5 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048722.157169:0:17101:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff959c04ca4000 10000000:01000000:3.0:1789048722.157173:0:17101:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789048722.157177:0:17101:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff959c04ca4000 10000000:01000000:3.0:1789048722.157180:0:17101:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789048722.157183:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff959c04ca4000 from 1 10000000:01000000:3.0:1789048722.157185:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789048722.157205:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3cc00/0x133f221c08776efc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048722.157213:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef3cc00/0x133f221c08776efc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048722.157221:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef3cc00/0x133f221c08776efc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048722.157233:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111441664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789048722.157257:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048722.157694:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c4153e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789048722.157774:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111441664 00000100:00100000:0.0:1789048722.157779:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111441664 00000100:00100000:0.0:1789048722.157801:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789048722.157808:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+6:17101:x1875953111441664:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789048722.157816:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048722.157828:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b08365400/0x133f221c08776f03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08776efc expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048722.157845:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b08365400/0x133f221c08776f03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08776efc expref: 7 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048722.157854:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b08365400/0x133f221c08776f03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08776efc expref: 7 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048722.157862:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08365400, rc 0) 00000100:00100000:0.0:1789048722.157899:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+7:17101:x1875953111441664:12345-0@lo:101:mount.lustre.0 Request processed in 92us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048722.157907:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789048722.157988:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111441664:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789048722.157999:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef3cc00/0x133f221c08776efc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776f03 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048722.158008:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3cc00/0x133f221c08776efc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08776f03 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048722.158040:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789048722.158053:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3cc00/0x133f221c08776efc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776f03 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048722.158061:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef3cc00/0x133f221c08776efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776f03 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048722.158068:0:17101:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789048722.158071:0:17101:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789048722.158075:0:17101:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff959c04ca4000 10000000:01000000:3.0:1789048722.158078:0:17101:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789048722.158081:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789048722.158084:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789048722.158098:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08776f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048722.158106:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08776f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048722.158114:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08776f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048722.158126:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111441792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789048722.158151:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048722.158163:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c4153e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789048722.158267:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111441792 00000100:00100000:0.0:1789048722.158272:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111441792 00000100:00100000:0.0:1789048722.158289:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789048722.158294:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+7:17101:x1875953111441792:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789048722.158312:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048722.158321:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b08364e00/0x133f221c08776f11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08776f0a expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048722.158466:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b08364e00/0x133f221c08776f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08776f0a expref: 8 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048722.158474:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b08364e00/0x133f221c08776f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08776f0a expref: 8 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048722.158480:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08364e00, rc 0) 00000100:00100000:0.0:1789048722.158514:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+8:17101:x1875953111441792:12345-0@lo:101:mount.lustre.0 Request processed in 220us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048722.158520:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789048722.158659:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111441792:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789048722.158670:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08776f0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776f11 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048722.158682:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08776f0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08776f11 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048722.158728:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111441920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048722.158754:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048722.158785:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c4153e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789048722.158917:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111441920 00000100:00100000:0.0:1789048722.158922:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111441920 00000100:00100000:0.0:1789048722.158941:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789048722.158945:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+8:17101:x1875953111441920:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048722.159110:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+9:17101:x1875953111441920:12345-0@lo:501:mount.lustre.0 Request processed in 163us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048722.159117:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789048722.159187:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111441920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048722.159214:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111442048:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789048722.159250:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048722.159269:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c4153e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789048722.159325:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111442048 00000100:00100000:0.0:1789048722.159329:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111442048 00000100:00100000:0.0:1789048722.159359:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789048722.159365:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+9:17101:x1875953111442048:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789048722.160219:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+9:17101:x1875953111442048:12345-0@lo:503:mount.lustre.0 Request processed in 852us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048722.160229:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789048722.160325:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111442048:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789048722.160775:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17140:1875953111442176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048722.160811:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048722.160846:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c4153e300 going to sleep for 11 seconds 00000100:00100000:2.0:1789048722.160903:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111442176 00000100:00100000:2.0:1789048722.160909:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111442176 00000100:00100000:2.0:1789048722.160946:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789048722.160954:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+9:17140:x1875953111442176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789048722.161837:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+9:17140:x1875953111442176:12345-0@lo:502:llog_process_th.0 Request processed in 882us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048722.161847:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789048722.161939:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17140:1875953111442176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789048722.161965:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048722.161987:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048722.161989:0:17140:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789048722.161994:0:17140:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789048722.161997:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789048722.162011:0:17140:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff959b077ecd40) 00000020:00000080:3.0:1789048722.162098:0:17140:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789048722.162107:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789048722.162176:0:17140:0:(osd_handler.c:8921:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789048722.162183:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c08776f1f 00000020:00000080:3.0:1789048722.162433:0:17140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789048722.162438:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048722.162442:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048722.162443:0:17140:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789048722.162446:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048722.162449:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048722.162451:0:17140:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789048722.162454:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789048722.162461:0:17140:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff959b077e99c0) 00000020:00000080:3.0:1789048722.162471:0:17140:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789048722.162475:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789048722.162477:0:17140:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789048722.162480:0:17140:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789048722.162486:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789048722.162528:0:17140:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c04ca4000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789048722.162541:0:17140:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff959b077e8000) 00000020:00000080:3.0:1789048722.162549:0:17140:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789048722.162607:0:17140:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789048722.162613:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x133f221c08776f34 00000020:00000080:3.0:1789048722.162707:0:17140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789048722.162714:0:17140:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789048722.162718:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x133f221c08776f3b 00080000:01000000:3.0:1789048722.162723:0:17140:0:(osd_handler.c:8921:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789048722.162727:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c08776f42 00010000:00010000:2.0:1789048722.217182:0:17140:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789048722.217674:0:17140:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967536 00000001:00080000:2.0:1789048722.217944:0:17140:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789048722.218629:0:17140:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff959b07920000) 00000020:00000080:2.0:1789048722.218648:0:17140:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789048722.218726:0:17140:0:(osd_handler.c:8921:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789048722.218733:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c08776f50 00000020:00000080:0.0:1789048722.221890:0:17140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789048722.224755:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x133f221c08776f57 00000020:00000080:0.0:1789048722.228084:0:17140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789048722.228100:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048722.228109:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048722.228111:0:17140:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789048722.228115:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789048722.228118:0:17140:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1789048722.228119:0:17140:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789048722.228121:0:17140:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789048722.228122:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789048722.228125:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048722.228126:0:17140:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789048722.228129:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048722.228132:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048722.228134:0:17140:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789048722.228138:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789048722.228188:0:17140:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789048722.228204:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048722.228207:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048722.228208:0:17140:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789048722.228211:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048722.228214:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048722.228216:0:17140:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789048722.228219:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789048722.228224:0:17140:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:00000080:0.0:1789048722.228250:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789048722.228267:0:17140:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff959c3e880000) 00000020:00000080:0.0:1789048722.228283:0:17140:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789048722.228288:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789048722.228377:0:17140:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789048722.228383:0:17140:0:(osd_handler.c:8921:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789048722.228390:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c08776f65 00010000:00080000:0.0:1789048722.228422:0:17140:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959c03136800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:0.0:1789048722.229963:0:17140:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1789048722.233871:0:17140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789048722.233888:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789048722.233927:0:17140:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789048722.233950:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x133f221c08776f6c 00000100:00080000:1.0:1789048722.233961:0:17140:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789048722.233988:0:17140:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff959c03136800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048722.234034:0:17140:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fb9d180 x1875953111442304/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789048722.234063:0:17140:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1789048722.234109:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048722.234119:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048722.234121:0:17140:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789048722.234124:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789048722.234127:0:17140:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1789048722.234129:0:17140:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789048722.234130:0:17140:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789048722.234132:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789048722.234134:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048722.234136:0:17140:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789048722.234139:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789048722.234143:0:17140:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789048722.234146:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048722.234147:0:17140:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789048722.234150:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789048722.234154:0:17140:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:1.0:1789048722.234175:0:17140:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789048722.234177:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789048722.234188:0:17140:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff959c2022cd40) 00000020:00000080:1.0:1789048722.234199:0:17140:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789048722.234203:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789048722.234267:0:17140:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789048722.234272:0:17140:0:(osd_handler.c:8921:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789048722.234278:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c08776f7a 00000100:00100000:0.0:1789048722.234487:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111442304:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789048722.234559:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048722.234654:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111442304 00000100:00100000:0.0:1789048722.234662:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111442304 00000100:00100000:0.0:1789048722.234689:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789048722.234695:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875953111442304:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1789048722.234709:0:17127:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1789048722.236588:0:17140:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959c2ac8c000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1789048722.236816:0:17140:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1789048722.237636:0:17140:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789048722.238449:0:17140:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789048722.240639:0:17140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789048722.241073:0:17140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789048722.247849:0:17140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789048722.255235:0:17146:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789048722.255245:0:17146:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1789048722.257903:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875953111442304:12345-0@lo:38:llog_process_th.0 Request processed in 23194us (23331us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789048722.257922:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789048722.258046:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c03136800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789048722.258052:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789048722.258056:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111442304:0@lo:38:llog_process_th.0 00000020:00000080:0.0:1789048722.259184:0:17140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789048722.259199:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789048722.259241:0:17140:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789048722.259262:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x133f221c08776f81 00000100:00080000:0.0:1789048722.259271:0:17140:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789048722.259281:0:17140:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff959c2ac8c000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048722.259324:0:17140:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080dad80 x1875953111442432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048722.259506:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111442432:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789048722.259550:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875953111442432 offset 0 length 520: 4 00000100:00080000:0.0:1789048722.259611:0:17140:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789048722.259670:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048722.259675:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048722.259677:0:17140:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789048722.259680:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789048722.259683:0:17140:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1789048722.259685:0:17140:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789048722.259686:0:17140:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789048722.259688:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789048722.259690:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048722.259692:0:17140:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789048722.259700:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789048722.259704:0:17140:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789048722.259708:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048722.259709:0:17140:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789048722.259712:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789048722.259716:0:17140:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:0.0:1789048722.259735:0:17140:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789048722.259737:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789048722.259749:0:17140:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff959c3e8819c0) 00000020:00000080:0.0:1789048722.259761:0:17140:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1789048722.259765:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789048722.259833:0:17140:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789048722.259840:0:17140:0:(osd_handler.c:8921:osd_obd_connect()) connect #7 00000020:00000080:0.0:1789048722.259845:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c08776f8f 00010000:00080000:0.0:1789048722.259870:0:17140:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959c2ac8e800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:0.0:1789048722.260149:0:17140:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789048722.260218:0:17140:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789048722.260233:0:17140:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:2.0:1789048722.260882:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789048722.260892:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789048722.260895:0:36:0:(import.c:65:import_set_state_nolock()) ffff959c03136800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048722.260901:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 476 00000100:00080000:2.0:1789048722.260905:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789048722.260912:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff959c03136800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048722.260929:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c08a8d880 x1875953111442688/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789048722.261023:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3622:1875953111442560:0@lo:400:kworker.0 00000100:00100000:0.0:1789048722.261072:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048722.261126:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111442560 00000100:00100000:0.0:1789048722.261133:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111442560 00000100:00100000:0.0:1789048722.261170:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789048722.261178:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+9:3622:x1875953111442560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048722.261224:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+9:3622:x1875953111442560:12345-0@lo:400:kworker.0 Request processed in 46us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048722.261232:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789048722.261280:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3622:1875953111442560:0@lo:400:kworker.0 00000040:00080000:1.0:1789048722.262660:0:17140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789048722.262889:0:17140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789048722.263029:0:17140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1789048722.263480:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111442688:0@lo:38:kworker.0 00000100:00100000:3.0:1789048722.263546:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048722.263604:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111442688 00000100:00100000:3.0:1789048722.263611:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111442688 00000100:00100000:3.0:1789048722.263641:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789048722.263648:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3619:x1875953111442688:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789048722.263666:0:17128:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789048722.263706:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3619:x1875953111442688:12345-0@lo:38:kworker.0 Request processed in 56us (159us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789048722.263712:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789048722.263757:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c03136800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789048722.263762:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789048722.263766:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111442688:0@lo:38:kworker.0 00000040:00080000:1.0:1789048722.264179:0:17148:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789048722.264184:0:17148:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789048722.265007:0:17140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789048722.265093:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789048722.265129:0:17140:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789048722.265148:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x133f221c08776f96 00000100:00080000:0.0:1789048722.265156:0:17140:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789048722.265166:0:17140:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff959c2ac8e800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048722.265196:0:17140:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080dbb80 x1875953111442816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048722.265256:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111442816:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789048722.265434:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875953111442816 offset 0 length 520: 4 00000100:00080000:0.0:1789048722.265509:0:17140:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789048722.265562:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048722.265566:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048722.265569:0:17140:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789048722.265571:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048722.265575:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048722.265577:0:17140:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789048722.265579:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789048722.265581:0:17140:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789048722.265583:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048722.265585:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048722.265586:0:17140:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789048722.265589:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048722.265591:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048722.265593:0:17140:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789048722.265596:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789048722.265622:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17140:1875953111442944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048722.265665:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048722.265697:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111442944 00000100:00100000:0.0:1789048722.265702:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111442944 00000100:00100000:0.0:1789048722.265738:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789048722.265746:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+9:17140:x1875953111442944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048722.265850:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+9:17140:x1875953111442944:12345-0@lo:502:llog_process_th.0 Request processed in 105us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048722.265863:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789048722.265904:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c034fd900 going to sleep for 11 seconds 00000100:00100000:0.0:1789048722.265922:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17140:1875953111442944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789048722.265943:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048722.265947:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048722.265949:0:17140:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789048722.265952:0:17140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789048722.266015:0:17101:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1789048722.266048:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789048722.266063:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08776f0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776f11 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048722.266073:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08776f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776f11 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048722.266081:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c04ca4000 from 1 10000000:01000000:0.0:1789048722.266083:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789048722.266107:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c08776f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048722.266115:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c08776f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048722.266123:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c08776f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048722.266135:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111443072:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789048722.266159:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048722.266177:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c034fd900 going to sleep for 11 seconds 00000100:00100000:2.0:1789048722.266566:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111443072 00000100:00100000:2.0:1789048722.266572:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111443072 00000100:00100000:2.0:1789048722.266606:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789048722.266613:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+9:17101:x1875953111443072:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789048722.266623:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048722.266637:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c04cb0600/0x133f221c08776fa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08776f9d expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.266656:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c04cb0600/0x133f221c08776fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08776f9d expref: 10 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.266666:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c04cb0600/0x133f221c08776fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08776f9d expref: 10 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.266675:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb0600, rc 0) 00000100:00100000:2.0:1789048722.266719:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+10:17101:x1875953111443072:12345-0@lo:101:mount.lustre.0 Request processed in 106us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048722.266725:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789048722.266802:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111443072:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789048722.266816:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c08776f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776fa4 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048722.266825:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c08776f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08776fa4 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048722.267401:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111443200:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789048722.267445:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048722.267471:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3e87e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789048722.267707:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111443200 00000100:00100000:0.0:1789048722.267713:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111443200 00000100:00100000:0.0:1789048722.267742:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789048722.267750:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+10:17101:x1875953111443200:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789048722.267765:0:17115:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789048722.267770:0:17115:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789048722.267838:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+10:17101:x1875953111443200:12345-0@lo:256:mount.lustre.0 Request processed in 88us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048722.267845:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789048722.267953:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111443200:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789048722.268638:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789048722.268656:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c08776f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776fa4 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048722.268667:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c08776f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776fa4 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048722.268675:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c04ca4000 from 1 10000000:01000000:1.0:1789048722.268678:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789048722.268708:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba1400/0x133f221c08776fab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048722.268715:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b07ba1400/0x133f221c08776fab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048722.268724:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b07ba1400/0x133f221c08776fab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048722.268801:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111443328:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789048722.268837:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048722.268862:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3e87e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789048722.268949:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111443328 00000100:00100000:0.0:1789048722.268955:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111443328 00000100:00100000:0.0:1789048722.268995:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789048722.269002:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+10:17101:x1875953111443328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789048722.269012:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048722.269135:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b08365a00/0x133f221c08776fb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08776fab expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048722.269155:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b08365a00/0x133f221c08776fb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08776fab expref: 11 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048722.269165:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b08365a00/0x133f221c08776fb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08776fab expref: 11 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048722.269174:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08365a00, rc 0) 00000100:00100000:0.0:1789048722.269215:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+11:17101:x1875953111443328:12345-0@lo:101:mount.lustre.0 Request processed in 213us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048722.269221:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789048722.269648:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111443328:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789048722.269663:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b07ba1400/0x133f221c08776fab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776fb2 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048722.269671:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b07ba1400/0x133f221c08776fab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08776fb2 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048722.269735:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111443456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789048722.269763:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048722.269828:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3e87e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789048722.269957:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111443456 00000100:00100000:2.0:1789048722.269963:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111443456 00000100:00100000:2.0:1789048722.270102:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789048722.270119:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+11:17101:x1875953111443456:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048722.270255:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+11:17101:x1875953111443456:12345-0@lo:501:mount.lustre.0 Request processed in 137us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048722.270263:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789048722.270326:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111443456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789048722.270376:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111443584:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789048722.270414:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048722.270740:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3e87e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789048722.270785:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111443584 00000100:00100000:0.0:1789048722.270796:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111443584 00000100:00100000:0.0:1789048722.270817:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789048722.270825:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+11:17101:x1875953111443584:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789048722.270945:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+11:17101:x1875953111443584:12345-0@lo:503:mount.lustre.0 Request processed in 121us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048722.270952:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789048722.271115:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111443584:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789048722.271683:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17150:1875953111443712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789048722.271723:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048722.271781:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c1142d600 going to sleep for 11 seconds 00000100:00100000:0.0:1789048722.271812:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111443712 00000100:00100000:0.0:1789048722.271817:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111443712 00000100:00100000:0.0:1789048722.271877:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789048722.271884:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+11:17150:x1875953111443712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048722.272545:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+11:17150:x1875953111443712:12345-0@lo:502:llog_process_th.0 Request processed in 659us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048722.272553:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789048722.272672:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17150:1875953111443712:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789048722.272702:0:17150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048722.272711:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048722.272714:0:17150:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789048722.272722:0:17150:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959c04ca4000 00000020:00000080:3.0:1789048722.272725:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789048722.272733:0:17150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048722.272735:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048722.272737:0:17150:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789048722.272739:0:17150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048722.272741:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048722.272742:0:17150:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789048722.272756:0:17150:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959c04ca4000 00000020:00000080:3.0:1789048722.272758:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789048722.272850:0:17150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048722.272854:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048722.272856:0:17150:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789048722.272859:0:17150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048722.272861:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048722.272862:0:17150:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789048722.272865:0:17150:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959c04ca4000 00000020:00000080:3.0:1789048722.272867:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789048722.274130:0:17150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048722.274138:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048722.274139:0:17150:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789048722.274143:0:17150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048722.274146:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048722.274148:0:17150:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789048722.274152:0:17150:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959c04ca4000 00000020:00000080:3.0:1789048722.274154:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789048722.274217:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08847480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17150:1875953111443840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048722.274282:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048722.274465:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41497d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789048722.276147:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111443840 00000100:00100000:2.0:1789048722.276160:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111443840 00000100:00100000:2.0:1789048722.276213:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789048722.276224:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+11:17150:x1875953111443840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789048722.277229:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+11:17150:x1875953111443840:12345-0@lo:502:llog_process_th.0 Request processed in 1004us (2943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048722.277239:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789048722.277475:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08847480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17150:1875953111443840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789048722.277512:0:17150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048722.277519:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048722.277522:0:17150:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789048722.277527:0:17150:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789048722.282625:0:17101:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789048722.282666:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789048722.282690:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba1400/0x133f221c08776fab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776fb2 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.282704:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b07ba1400/0x133f221c08776fab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776fb2 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048722.282766:0:17101:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789048722.282769:0:17101:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff959c04ca4000 10000000:01000000:2.0:1789048722.282772:0:17101:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff959c04ca4000 10000000:01000000:2.0:1789048722.282776:0:17101:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789048722.282783:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959c04ca4000 from 1 10000000:01000000:2.0:1789048722.282792:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789048722.282824:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c04cb1c00/0x133f221c08776fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.282830:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c04cb1c00/0x133f221c08776fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.282838:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c04cb1c00/0x133f221c08776fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048722.282856:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111443968:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789048722.282919:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048722.282956:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c1142dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789048722.283129:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111443968 00000100:00100000:0.0:1789048722.283136:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111443968 00000100:00100000:0.0:1789048722.286405:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789048722.286425:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+11:17101:x1875953111443968:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789048722.286446:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048722.286466:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b08364000/0x133f221c08776fc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08776fb9 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048722.286494:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b08364000/0x133f221c08776fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08776fb9 expref: 12 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048722.286507:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b08364000/0x133f221c08776fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08776fb9 expref: 12 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048722.286515:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08364000, rc 0) 00000100:00100000:0.0:1789048722.286614:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:17101:x1875953111443968:12345-0@lo:101:mount.lustre.0 Request processed in 198us (3695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048722.286622:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789048722.289355:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111443968:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789048722.289385:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c04cb1c00/0x133f221c08776fb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776fc0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048722.289411:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c04cb1c00/0x133f221c08776fb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08776fc0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048722.289493:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08847480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111444096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048722.289548:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048722.295443:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41497d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789048722.295530:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111444096 00000100:00100000:2.0:1789048722.295538:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111444096 00000100:00100000:2.0:1789048722.295593:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789048722.295601:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:17101:x1875953111444096:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048722.295739:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:17101:x1875953111444096:12345-0@lo:501:mount.lustre.0 Request processed in 138us (6191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048722.295746:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789048722.298586:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08847480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111444096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048722.298649:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111444224:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789048722.298719:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048722.298766:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0745f600 going to sleep for 11 seconds 00000100:00100000:2.0:1789048722.299374:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111444224 00000100:00100000:2.0:1789048722.299382:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111444224 00000100:00100000:2.0:1789048722.299426:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789048722.299436:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:17101:x1875953111444224:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789048722.299687:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:17101:x1875953111444224:12345-0@lo:503:mount.lustre.0 Request processed in 253us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048722.299695:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789048722.300723:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111444224:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789048722.302646:0:17155:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17155:1875953111444352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048722.302733:0:17155:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048722.302774:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111444352 00000100:00100000:0.0:1789048722.302781:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111444352 00000100:00100000:0.0:1789048722.302817:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789048722.302826:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:17155:x1875953111444352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048722.302954:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:17155:x1875953111444352:12345-0@lo:502:llog_process_th.0 Request processed in 128us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048722.302962:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789048722.303033:0:17155:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0745f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048722.303055:0:17155:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17155:1875953111444352:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789048722.303111:0:17155:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789048722.303126:0:17155:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff959c3e883380) 00000020:00000080:0.0:1789048722.303144:0:17155:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1789048722.303223:0:17155:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c04ca4000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789048722.303238:0:17155:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959c04ca4000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789048722.303242:0:17155:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c04ca4000 4 00010000:00080000:0.0:1789048722.303276:0:17155:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959c2b600800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:0.0:1789048722.304862:0:17155:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1789048722.309521:0:17155:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789048722.309587:0:17155:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789048722.309601:0:17155:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x133f221c08776fce 00000100:00080000:0.0:1789048722.309612:0:17155:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789048722.309623:0:17155:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff959c2b600800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048722.309660:0:17155:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080d8380 x1875953111444480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048722.309722:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875953111444480:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789048722.309802:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048722.314498:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111444480 00000100:00100000:0.0:1789048722.314514:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111444480 00000100:00100000:0.0:1789048722.314556:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789048722.314563:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111444480:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789048722.317224:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111444480:12345-0@lo:38:llog_process_th.0 Request processed in 2653us (7413us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789048722.317247:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789048722.318868:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789048722.318881:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c2b600800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789048722.318981:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789048722.318986:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875953111444480:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789048722.321123:0:17155:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789048722.329426:0:17155:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17155:1875953111444608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048722.329512:0:17155:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048722.329551:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111444608 00000100:00100000:0.0:1789048722.329560:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111444608 00000100:00100000:0.0:1789048722.329611:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789048722.329621:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:17155:x1875953111444608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048722.329742:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:17155:x1875953111444608:12345-0@lo:502:llog_process_th.0 Request processed in 122us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048722.329750:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789048722.329799:0:17155:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0745fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789048722.329826:0:17155:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17155:1875953111444608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048722.329869:0:17155:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17155:1875953111444736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048722.329898:0:17155:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048722.329923:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111444736 00000100:00100000:0.0:1789048722.329926:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111444736 00000100:00100000:0.0:1789048722.329946:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789048722.329953:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:17155:x1875953111444736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048722.333149:0:17155:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0745fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789048722.333550:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:17155:x1875953111444736:12345-0@lo:502:llog_process_th.0 Request processed in 3591us (3644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048722.333565:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789048722.333953:0:17155:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17155:1875953111444736:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789048722.334005:0:17155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789048722.334223:0:17101:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789048722.334257:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789048722.334280:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c04cb1c00/0x133f221c08776fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776fc0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048722.334291:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c04cb1c00/0x133f221c08776fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776fc0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789048722.334585:0:17101:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789048722.334587:0:17101:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789048722.334588:0:17101:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048722.334589:0:17101:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048722.334590:0:17101:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048722.334592:0:17101:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048722.334593:0:17101:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789048722.334594:0:17101:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789048722.334596:0:17101:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048722.334597:0:17101:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789048722.334601:0:17101:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789048722.334603:0:17101:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789048722.334608:0:17101:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789048722.334609:0:17101:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048722.334610:0:17101:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048722.334611:0:17101:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048722.334612:0:17101:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048722.334613:0:17101:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789048722.334613:0:17101:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789048722.334614:0:17101:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048722.334615:0:17101:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789048722.334636:0:17101:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789048722.334651:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111444864:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789048722.334706:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048722.334801:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0745f000 going to sleep for 11 seconds 00000100:00100000:1.0:1789048722.335713:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111444864 00000100:00100000:1.0:1789048722.335722:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111444864 00000100:00100000:1.0:1789048722.337123:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789048722.337143:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:17101:x1875953111444864:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789048722.337177:0:17116:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789048722.337192:0:17116:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789048722.342203:0:17116:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789048722.342264:0:17116:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789048722.343736:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:17101:x1875953111444864:12345-0@lo:253:mount.lustre.0 Request processed in 6585us (9017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048722.343749:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 20000000:01000000:3.0:1789048722.343895:0:17138:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789048722.343900:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789048722.343925:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff959c3ef3c400/0x133f221c08776fd5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048722.343941:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c04cb0600/0x133f221c08776fa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08776f9d expref: 11 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048722.343949:0:17138:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959c3ef3c400/0x133f221c08776fd5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048722.344098:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c04cb0600/0x133f221c08776fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08776f9d expref: 11 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048722.344115:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c04cb0600/0x133f221c08776fa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08776f9d expref: 11 pid: 17117 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048722.344138:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08847800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1875953111444992:0@lo:104: 00000100:00100000:3.0:1789048722.344174:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048722.344254:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41497a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789048722.344523:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17101:1875953111444864:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789048722.344534:0:17101:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789048722.344537:0:17101:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789048722.344539:0:17101:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789048722.344540:0:17101:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789048722.344541:0:17101:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789048722.344542:0:17101:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789048722.344544:0:17101:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789048722.344545:0:17101:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789048722.344547:0:17101:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789048722.344549:0:17101:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789048722.344550:0:17101:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789048722.344567:0:17101:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789048722.348555:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111444992 00000100:00100000:1.0:1789048722.348568:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111444992 00000100:00100000:1.0:1789048722.348630:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789048722.348641:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+3:17138:x1875953111444992:12345-0@lo:104: 00010000:00010000:1.0:1789048722.348660:0:17105:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c08776f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08776fa4 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048722.348758:0:17105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789048722.348765:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+3:17138:x1875953111444992:12345-0@lo:104: Request processed in 127us (4591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048722.348771:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789048722.349213:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08847800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1875953111444992:0@lo:104: 00010000:00010000:3.0:1789048722.349486:0:17138:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff959c3ef3c400/0x133f221c08776fd5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.349598:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048722.349618:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c08776f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08776fa4 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.349626:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08365200 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048722.349630:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c08776f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08776fa4 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.349638:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c08776f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08776fa4 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048722.349645:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c08776f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08776fa4 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048722.349650:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789048722.349690:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c08776f9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08776fa4 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.349696:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048722.349716:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c08776f9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08776fa4 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.349723:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c08776f9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08776fa4 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.349739:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048722.349741:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048722.349742:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048722.349756:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111445120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048722.349817:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048722.349955:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111445120 00000100:00100000:2.0:1789048722.349978:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111445120 00010000:00010000:2.0:1789048722.350000:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c04cb0600/0x133f221c08776fa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08776f9d expref: 12 pid: 17117 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048722.350035:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789048722.350043:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:3623:x1875953111445120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048722.350055:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048722.350060:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c04cb0600/0x133f221c08776fa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08776f9d expref: 12 pid: 17117 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.350069:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c04cb0600/0x133f221c08776fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08776f9d expref: 12 pid: 17117 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.350082:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c04cb0600/0x133f221c08776fa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08776f9d expref: 12 pid: 17117 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.350095:0:17107:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959c3ef3c400/0x133f221c08776fd5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.350103:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3c400/0x133f221c08776fd5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789048722.350117:0:17107:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006217463s 00010000:00010000:2.0:1789048722.350122:0:17107:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef3c400/0x133f221c08776fd5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.350128:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef3c400/0x133f221c08776fd5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.350134:0:17107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff959c3ef3c400/0x133f221c08776fd5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.350153:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff959c3ef3c400/0x133f221c08776fd5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.350159:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c400 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048722.350164:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff959c3ef3c400/0x133f221c08776fd5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.350171:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff959c3ef3c400/0x133f221c08776fd5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.350186:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff959c3ef3c400/0x133f221c08776fd5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.350195:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048722.350226:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+11:3623:x1875953111445120:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048722.350435:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789048722.350471:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111445120:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048722.350495:0:17138:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff959c3ef3c400/0x133f221c08776fd5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.350503:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff959c3ef3c400/0x133f221c08776fd5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048722.350509:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3c400/0x133f221c08776fd5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789048722.361893:0:17101:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1789048722.362187:0:17101:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1789048722.363208:0:17163:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789048722.363328:0:17101:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1789048722.364131:0:17163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1789048722.367305:0:17162:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1789048722.367316:0:17162:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00080000:2.0:1789048722.368777:0:17164:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff959c08a8d500 x1875953111445248/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048722.368793:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 00000040:01000000:0.0:1789048722.370151:0:17101:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789048722.370199:0:17101:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789048722.370668:0:17163:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789048722.370739:0:17163:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:0.0:1789048722.371865:0:17101:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789048722.371878:0:17101:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789048722.371948:0:17101:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789048722.377568:0:17101:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789048722.384525:0:17101:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789048722.384597:0:17101:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1789048722.389605:0:17101:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1789048722.396182:0:17101:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789048722.398002:0:17101:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789048722.398049:0:17101:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb770c1c57988 00100000:10000000:1.0:1789048722.398057:0:17101:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789048722.399099:0:17101:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789048722.399114:0:17101:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789048722.399132:0:17101:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1789048722.399153:0:17101:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1789048722.403707:0:17101:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789048722.403946:0:17101:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789048723.037514:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789048723.357977:0:17157:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789048723.421695:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 10000000:01000000:1.0:1789048723.935851:0:17119:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789048723.935858:0:17119:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c04ca4000 from 7 10000000:01000000:1.0:1789048723.935862:0:17119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789048723.935909:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba0000/0x133f221c08776fdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048723.935922:0:17119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b07ba0000/0x133f221c08776fdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048723.935933:0:17119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b07ba0000/0x133f221c08776fdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048723.935968:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111445376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789048723.936046:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048723.936147:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2aca5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789048723.940145:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111445376 00000100:00100000:0.0:1789048723.940162:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111445376 00000100:00100000:0.0:1789048723.940294:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789048723.940304:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+11:17119:x1875953111445376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789048723.940324:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048723.940371:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b08364800/0x133f221c08776fe3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08776fdc expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048723.940402:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b08364800/0x133f221c08776fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08776fdc expref: 12 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048723.940414:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b08364800/0x133f221c08776fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08776fdc expref: 12 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048723.940442:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08364800, rc 0) 00000100:00100000:0.0:1789048723.940531:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:17119:x1875953111445376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (4484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048723.940539:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789048723.940762:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111445376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048723.940780:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b07ba0000/0x133f221c08776fdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776fe3 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048723.940789:0:17119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b07ba0000/0x133f221c08776fdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08776fe3 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048723.940870:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111445504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789048723.940918:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048723.944034:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2aca5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789048723.944208:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111445504 00000100:00100000:0.0:1789048723.944219:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111445504 00000100:00100000:0.0:1789048723.944275:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789048723.944286:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:17119:x1875953111445504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789048723.944313:0:17117:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789048723.944360:0:17117:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789048723.944363:0:17117:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789048723.944497:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:17119:x1875953111445504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 214us (3578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048723.944505:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789048723.945319:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111445504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789048723.945402:0:17119:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789048723.945413:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba0000/0x133f221c08776fdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776fe3 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048723.945425:0:17119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b07ba0000/0x133f221c08776fdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776fe3 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048724.063163:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789048724.383365:0:17157:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789048724.445447:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 00010000:00010000:2.0:1789048725.089427:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048725.474675:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 00010000:00010000:1.0:1789048726.115468:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048726.493866:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 00010000:00010000:2.0:1789048727.134517:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789048727.331094:0:17407:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1789048727.520733:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 00000100:00080000:1.0:1789048727.524748:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789048727.524756:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789048727.524760:0:37:0:(import.c:65:import_set_state_nolock()) ffff959c03136800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789048727.524769:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 477 00000100:00080000:1.0:1789048727.524775:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789048727.524786:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff959c03136800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048727.524811:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fb9d180 x1875953111445760/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789048727.524823:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048727.524826:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789048727.524829:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048727.524831:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789048727.524834:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789048727.524837:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789048727.524839:0:37:0:(import.c:65:import_set_state_nolock()) ffff959c2b600800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789048727.524845:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff959c2b600800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048727.524889:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fb9ed80 x1875953111445888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048727.525736:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111445632:0@lo:400:kworker.0 00000100:00100000:3.0:1789048727.525823:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048727.525927:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111445632 00000100:00100000:1.0:1789048727.525936:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111445632 00000100:00100000:1.0:1789048727.526068:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789048727.526078:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:3620:x1875953111445632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048727.526130:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:3620:x1875953111445632:12345-0@lo:400:kworker.0 Request processed in 54us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048727.526137:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789048727.526209:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111445760:0@lo:38:kworker.0 00000100:00100000:2.0:1789048727.526244:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048727.526442:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875953111445888:0@lo:38:kworker.0 00000100:00100000:2.0:1789048727.526466:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048727.526520:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111445760 00000100:00100000:0.0:1789048727.526525:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111445760 00000100:00100000:0.0:1789048727.526569:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789048727.526574:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3619:x1875953111445760:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789048727.526590:0:17128:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789048727.530476:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111445888 00000100:00100000:2.0:1789048727.530489:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111445888 00000100:00100000:2.0:1789048727.530530:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789048727.530538:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875953111445888:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789048727.530564:0:17124:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:2.0:1789048727.530602:0:17124:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x133f221c08776fea 00000004:00100000:2.0:1789048727.530617:0:17124:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789048727.530740:0:17124:0:(import.c:65:import_set_state_nolock()) ffff959c33596800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789048727.530813:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875953111445888:12345-0@lo:38:kworker.0 Request processed in 275us (4345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048727.530820:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789048727.530860:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111445632:0@lo:400:kworker.0 00010000:00080000:2.0:1789048727.530898:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff959c3fb9ed80 x1875953111445888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789048737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789048727.530944:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789048727.530952:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789048727.530958:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789048727.530960:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c2b600800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789048727.530974:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875953111445888:0@lo:38:kworker.0 00000100:00100000:1.0:1789048727.541565:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3619:x1875953111445760:12345-0@lo:38:kworker.0 Request processed in 14980us (15310us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789048727.541586:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789048727.541705:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c03136800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789048727.541711:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789048727.541716:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111445760:0@lo:38:kworker.0 00010000:00010000:2.0:1789048728.157958:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789048728.377236:0:17459:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789048728.377464:0:17459:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789048728.541977:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 00010000:00010000:2.0:1789048729.181567:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789048729.504894:0:17509:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789048729.505202:0:17509:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789048729.566535:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 00010000:00010000:2.0:1789048730.208425:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048730.597123:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 00010000:00010000:3.0:1789048731.230092:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048731.613505:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 00010000:00010000:2.0:1789048732.260832:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048732.644444:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048722/real 1789048722] req@ffff959b080dbb80 x1875953111442816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048732 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048732.644477:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959b080dbb80 x1875953111442816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048732 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048732.644488:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048722/real 1789048722] req@ffff959b080dad80 x1875953111442432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048732 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048732.644499:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959b080dad80 x1875953111442432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048732 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789048732.644515:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048732.644536:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789048732.644540:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111442816:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789048732.644545:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048732.644549:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789048732.644568:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111442432:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789048732.645721:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789048732.645727:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789048732.645730:0:37:0:(import.c:65:import_set_state_nolock()) ffff959c03136800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789048732.645736:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1789048732.645742:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789048732.645753:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff959c03136800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048732.645775:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b08844e00 x1875953111446144/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789048732.645794:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789048732.645797:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789048732.645799:0:37:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789048732.645802:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 477 00000100:00080000:3.0:1789048732.645806:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789048732.645810:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff959c2ac8c000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048732.645822:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b08845880 x1875953111446272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789048732.645831:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789048732.645833:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789048732.645846:0:37:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789048732.645850:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 477 00000100:00080000:3.0:1789048732.645852:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789048732.645857:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff959c2ac8e800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048732.645978:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111446016:0@lo:400:kworker.0 00000100:00100000:0.0:1789048732.646044:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048732.646116:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111446016 00000100:00100000:0.0:1789048732.646131:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111446016 00000100:00100000:0.0:1789048732.646180:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789048732.646188:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:3621:x1875953111446016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048732.646237:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:3621:x1875953111446016:12345-0@lo:400:kworker.0 Request processed in 49us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048732.646244:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789048732.646291:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111446016:0@lo:400:kworker.0 00000100:00100000:3.0:1789048732.646612:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b08847480 x1875953111446400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048732.646657:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111446144:0@lo:38:kworker.0 00000100:00100000:3.0:1789048732.646712:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048732.646734:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111446272:0@lo:8:kworker.0 00000400:00000100:3.0:1789048732.646751:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875953111446272 offset 0 length 520: 4 00000100:00100000:3.0:1789048732.646767:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111446400:0@lo:8:kworker.0 00000400:00000100:3.0:1789048732.646781:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875953111446400 offset 0 length 520: 4 00000100:00100000:3.0:1789048732.646805:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111446144 00000100:00100000:3.0:1789048732.646809:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111446144 00000100:00100000:3.0:1789048732.646831:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789048732.646836:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875953111446144:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789048732.646851:0:17127:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789048732.646979:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111446528:0@lo:400:kworker.0 00000100:00100000:2.0:1789048732.647011:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048732.648013:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111446528 00000100:00100000:0.0:1789048732.648020:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111446528 00000100:00100000:0.0:1789048732.648064:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789048732.648073:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111446528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048732.648132:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111446528:12345-0@lo:400:kworker.0 Request processed in 61us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048732.648139:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789048732.648191:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff959b08845c00 x1875953111446528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048732.648204:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111446528:0@lo:400:kworker.0 00000100:00100000:0.0:1789048732.652578:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 00000100:00100000:0.0:1789048732.682483:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875953111446144:12345-0@lo:38:kworker.0 Request processed in 35636us (35761us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789048732.682498:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789048732.686468:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c03136800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789048732.686482:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789048732.686487:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111446144:0@lo:38:kworker.0 00010000:00010000:3.0:1789048733.280741:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048733.663536:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 00010000:00010000:3.0:1789048734.302760:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789048734.641665:0:17157:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789048734.686530:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 00010000:00010000:2.0:1789048735.331518:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048735.709479:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 00010000:00010000:3.0:1789048736.358233:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048736.733540:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 00010000:00010000:2.0:1789048737.381587:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048737.759053:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 00000100:00080000:2.0:1789048737.777975:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789048737.777981:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789048737.777985:0:37:0:(import.c:65:import_set_state_nolock()) ffff959c03136800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048737.777993:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:2.0:1789048737.777998:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789048737.778009:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff959c03136800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048737.778030:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c08a8e300 x1875953111446784/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789048737.778045:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048737.778048:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789048737.778050:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048737.778053:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789048737.778175:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111446656:0@lo:400:kworker.0 00000100:00100000:2.0:1789048737.778253:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048737.778314:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111446912:0@lo:400:kworker.0 00000100:00100000:2.0:1789048737.778364:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048737.778399:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111446656 00000100:00100000:2.0:1789048737.778406:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111446656 00000100:00100000:2.0:1789048737.778460:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789048737.778469:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:3623:x1875953111446656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048737.778930:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:3623:x1875953111446656:12345-0@lo:400:kworker.0 Request processed in 461us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048737.778938:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789048737.778976:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111446912 00000100:00100000:2.0:1789048737.778980:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111446912 00000100:00100000:2.0:1789048737.779052:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789048737.779060:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111446912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048737.779099:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111446912:12345-0@lo:400:kworker.0 Request processed in 40us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048737.779105:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789048737.800746:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111446784:0@lo:38:kworker.0 00000100:00100000:2.0:1789048737.800833:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048737.803002:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111446784 00000100:00100000:2.0:1789048737.803016:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111446784 00000100:00100000:2.0:1789048737.803066:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789048737.803075:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3619:x1875953111446784:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789048737.803096:0:17128:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1789048737.827179:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff959c08a8d880 x1875953111446912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048737.827200:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111446912:0@lo:400:kworker.0 00000100:00100000:1.0:1789048737.827240:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111446656:0@lo:400:kworker.0 00000100:00100000:2.0:1789048737.842237:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3619:x1875953111446784:12345-0@lo:38:kworker.0 Request processed in 39153us (41396us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789048737.842251:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789048737.842305:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c03136800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048737.842311:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789048737.842315:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111446784:0@lo:38:kworker.0 00010000:00010000:0.0:1789048738.411091:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789048738.700136:0:17855:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789048738.700140:0:17855:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789048738.700142:0:17855:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789048738.700252:0:17855:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff959c08aff800 00000020:01000004:0.0:1789048738.700267:0:17855:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1789048738.700279:0:17855:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789048738.700291:0:17855:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff959c3e884d40) 00000020:00000080:0.0:1789048738.700311:0:17855:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789048738.756816:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1789048738.758206:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789048738.760940:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789048738.761263:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789048738.761546:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789048738.761782:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789048738.762289:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789048738.762618:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789048738.762830:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1789048738.763317:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789048738.763548:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1789048738.764116:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789048738.764412:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789048738.764623:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789048738.764987:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789048738.765371:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1789048738.765616:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1789048738.765823:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1789048738.766327:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1789048738.766924:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1789048738.767270:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1789048738.767523:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1789048738.767772:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1789048738.768164:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789048738.768463:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1789048738.768722:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1789048738.768995:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1789048738.769461:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1789048738.769694:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789048738.770141:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1789048738.770606:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1789048738.771421:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1789048738.771782:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789048738.772111:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1789048738.776665:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789048738.777269:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1789048738.777907:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1789048738.778127:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789048738.778302:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789048738.778499:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789048738.778787:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1789048738.779202:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789048738.779480:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789048738.779742:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789048738.780054:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1789048738.780268:0:17855:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00000100:00100000:2.0:1789048738.781517:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 00080000:01000000:0.0:1789048738.783006:0:17855:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789048738.783229:0:17855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789048738.783240:0:17855:0:(osd_handler.c:8921:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789048738.783251:0:17855:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x133f221c08776ff8 00000020:01000004:0.0:1789048738.783258:0:17855:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789048738.783277:0:17855:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789048738.783280:0:17855:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789048738.783286:0:17855:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789048738.783533:0:17855:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789048738.783538:0:17855:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789048738.791900:0:17855:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789048738.791951:0:17855:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.116@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1789048738.791955:0:17855:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789048738.791957:0:17855:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789048738.791958:0:17855:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048738.791959:0:17855:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048738.791960:0:17855:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048738.791961:0:17855:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048738.791962:0:17855:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789048738.791964:0:17855:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048738.791965:0:17855:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789048738.791968:0:17855:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1789048738.791970:0:17855:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789048738.791972:0:17855:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789048738.791973:0:17855:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048738.791974:0:17855:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048738.791975:0:17855:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048738.791976:0:17855:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048738.791983:0:17855:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789048738.791983:0:17855:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048738.791984:0:17855:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789048738.792024:0:17855:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789048738.792046:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111447040:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789048738.792120:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048738.792566:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11507540 going to sleep for 11 seconds 00000100:00100000:1.0:1789048738.792982:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111447040 00000100:00100000:1.0:1789048738.792990:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111447040 00000100:00100000:1.0:1789048738.793086:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789048738.793097:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:17855:x1875953111447040:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789048738.793130:0:17115:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789048738.793143:0:17115:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1789048738.793151:0:17115:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789048738.793534:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:17855:x1875953111447040:12345-0@lo:253:mount.lustre.0 Request processed in 439us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048738.793544:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789048738.793655:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111447040:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789048738.793668:0:17855:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789048738.793671:0:17855:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789048738.793672:0:17855:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789048738.793674:0:17855:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048738.793675:0:17855:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048738.793676:0:17855:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048738.793678:0:17855:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048738.793679:0:17855:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789048738.793681:0:17855:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048738.793682:0:17855:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789048738.793724:0:17855:0:(tgt_mount.c:101:server_register_mount()) register mount ffff959c08aff800 from lustre-MDT0001 10000000:01000000:0.0:1789048738.793753:0:17855:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789048738.793756:0:17855:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789048738.793762:0:17855:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff959c20228000 local copy 00010000:00010000:0.0:1789048738.793772:0:17855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365600/0x133f221c08776eee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776ef5 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048738.793884:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111447168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048738.793916:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048738.794227:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11507300 going to sleep for 11 seconds 00000100:00100000:2.0:1789048738.794290:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111447168 00000100:00100000:2.0:1789048738.794295:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111447168 00000100:00100000:2.0:1789048738.794326:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789048738.794362:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:17855:x1875953111447168:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048738.794432:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:17855:x1875953111447168:12345-0@lo:501:mount.lustre.0 Request processed in 97us (514us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789048738.794439:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789048738.794549:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111447168:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789048738.794563:0:17855:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789048738.794583:0:17855:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789048738.794596:0:17855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365600/0x133f221c08776eee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776ef5 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048738.794606:0:17855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b08365600/0x133f221c08776eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776ef5 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048738.794634:0:17855:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff959c08aff800 10000000:01000000:0.0:1789048738.794638:0:17855:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789048738.794644:0:17855:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff959c20228000 10000000:01000000:0.0:1789048738.794646:0:17855:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789048738.794649:0:17855:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff959c20228000 from 1 10000000:01000000:0.0:1789048738.794652:0:17855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789048738.794675:0:17855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365800/0x133f221c08776fff lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048738.794684:0:17855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b08365800/0x133f221c08776fff lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048738.794692:0:17855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b08365800/0x133f221c08776fff lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048738.794706:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111447296:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789048738.794745:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048738.794761:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11507300 going to sleep for 11 seconds 00000100:00100000:2.0:1789048738.794957:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111447296 00000100:00100000:2.0:1789048738.794962:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111447296 00000100:00100000:2.0:1789048738.794981:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789048738.794987:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+12:17855:x1875953111447296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789048738.794996:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048738.795008:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c04cb0a00/0x133f221c08777006 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08776fff expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.795026:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c04cb0a00/0x133f221c08777006 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08776fff expref: 13 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.795037:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c04cb0a00/0x133f221c08777006 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08776fff expref: 13 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.795045:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb0a00, rc 0) 00000100:00100000:2.0:1789048738.795083:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+13:17855:x1875953111447296:12345-0@lo:101:mount.lustre.0 Request processed in 96us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048738.795089:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789048738.795159:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111447296:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789048738.795170:0:17855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b08365800/0x133f221c08776fff lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777006 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048738.795180:0:17855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b08365800/0x133f221c08776fff lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777006 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048738.795202:0:17855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789048738.795222:0:17855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365800/0x133f221c08776fff lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777006 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048738.795229:0:17855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b08365800/0x133f221c08776fff lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777006 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048738.795236:0:17855:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff959c08aff800 10000000:01000000:0.0:1789048738.795240:0:17855:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789048738.795243:0:17855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff959c08aff800 from 1 10000000:01000000:0.0:1789048738.795245:0:17855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789048738.795260:0:17855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08364200/0x133f221c0877700d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048738.795267:0:17855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b08364200/0x133f221c0877700d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048738.795274:0:17855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b08364200/0x133f221c0877700d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048738.795285:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111447424:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789048738.795313:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048738.795324:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11507300 going to sleep for 11 seconds 00000100:00100000:2.0:1789048738.795395:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111447424 00000100:00100000:2.0:1789048738.795399:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111447424 00000100:00100000:2.0:1789048738.795415:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789048738.795420:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+13:17855:x1875953111447424:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789048738.795425:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048738.795433:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c04cb1a00/0x133f221c08777014 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c0877700d expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.795444:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c04cb1a00/0x133f221c08777014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c0877700d expref: 14 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.795451:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c04cb1a00/0x133f221c08777014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c0877700d expref: 14 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.795463:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb1a00, rc 0) 00000100:00100000:2.0:1789048738.795496:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+14:17855:x1875953111447424:12345-0@lo:101:mount.lustre.0 Request processed in 75us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048738.795501:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789048738.795561:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111447424:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789048738.795569:0:17855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b08364200/0x133f221c0877700d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777014 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048738.795576:0:17855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b08364200/0x133f221c0877700d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777014 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048738.795591:0:17855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789048738.795604:0:17855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08364200/0x133f221c0877700d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777014 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048738.795610:0:17855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b08364200/0x133f221c0877700d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777014 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048738.795615:0:17855:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789048738.795618:0:17855:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789048738.795622:0:17855:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff959c08aff800 10000000:01000000:0.0:1789048738.795624:0:17855:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789048738.795627:0:17855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1789048738.795629:0:17855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789048738.795642:0:17855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08364600/0x133f221c0877701b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048738.795648:0:17855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b08364600/0x133f221c0877701b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048738.795655:0:17855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b08364600/0x133f221c0877701b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048738.795667:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111447552:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789048738.795692:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048738.795800:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111447552 00000100:00100000:2.0:1789048738.795804:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111447552 00000100:00100000:2.0:1789048738.795855:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789048738.795872:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+14:17855:x1875953111447552:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789048738.795879:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048738.795886:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c04cb1800/0x133f221c08777022 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c0877701b expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.795900:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c04cb1800/0x133f221c08777022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c0877701b expref: 15 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.795907:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c04cb1800/0x133f221c08777022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c0877701b expref: 15 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.795914:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb1800, rc 0) 00000100:00100000:2.0:1789048738.795940:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+15:17855:x1875953111447552:12345-0@lo:101:mount.lustre.0 Request processed in 69us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048738.795946:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789048738.796046:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11507300 going to sleep for 11 seconds 00000100:00100000:0.0:1789048738.796060:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111447552:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789048738.796069:0:17855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b08364600/0x133f221c0877701b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777022 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048738.796082:0:17855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b08364600/0x133f221c0877701b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777022 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789048738.797182:0:17855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1789048738.797954:0:17855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789048738.801971:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789048738.802026:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1789048738.802044:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1789048738.802059:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1789048738.802073:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1789048738.802087:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1789048738.802102:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1789048738.802116:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1789048738.802131:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1789048738.802146:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1789048738.802161:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1789048738.802175:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1789048738.802189:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1789048738.802204:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1789048738.802218:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1789048738.802231:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1789048738.802243:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1789048738.802258:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1789048738.802273:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1789048738.802286:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1789048738.802301:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1789048738.802314:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789048738.802328:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789048738.802447:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1789048738.802454:0:17855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1789048738.802566:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111447680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048738.802638:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048738.802827:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11507000 going to sleep for 11 seconds 00000100:00100000:2.0:1789048738.802933:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111447680 00000100:00100000:2.0:1789048738.802941:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111447680 00000100:00100000:2.0:1789048738.803036:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789048738.803046:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+15:17855:x1875953111447680:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048738.803194:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+15:17855:x1875953111447680:12345-0@lo:501:mount.lustre.0 Request processed in 150us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048738.803209:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789048738.803280:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111447680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048738.803312:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111447808:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789048738.803383:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048738.803597:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11507000 going to sleep for 11 seconds 00000100:00100000:1.0:1789048738.803658:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111447808 00000100:00100000:1.0:1789048738.803664:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111447808 00000100:00100000:1.0:1789048738.803688:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789048738.803695:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+15:17855:x1875953111447808:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789048738.804745:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+15:17855:x1875953111447808:12345-0@lo:503:mount.lustre.0 Request processed in 1047us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048738.804756:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789048738.805190:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111447808:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789048738.805653:0:17855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789048738.805930:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111447936:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048738.805984:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048738.806058:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11507300 going to sleep for 11 seconds 00000100:00100000:3.0:1789048738.806155:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111447936 00000100:00100000:3.0:1789048738.806162:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111447936 00000100:00100000:2.0:1789048738.806224:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789048738.806235:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+15:17855:x1875953111447936:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789048738.807040:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+15:17855:x1875953111447936:12345-0@lo:502:mount.lustre.0 Request processed in 806us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048738.807049:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789048738.807145:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111447936:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789048738.807421:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789048738.807453:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1789048738.807468:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1789048738.807479:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1789048738.807491:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1789048738.807505:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1789048738.807518:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1789048738.807532:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1789048738.807547:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1789048738.807560:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1789048738.807574:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1789048738.807587:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1789048738.807616:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1789048738.807632:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1789048738.807646:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1789048738.807670:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1789048738.807685:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1789048738.807701:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1789048738.807800:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1789048738.807832:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1789048738.807847:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1789048738.807923:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1789048738.807941:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1789048738.807958:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1789048738.807973:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1789048738.807988:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1789048738.808002:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1789048738.808018:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1789048738.808045:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1789048738.808060:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1789048738.808073:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1789048738.808086:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1789048738.808100:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1789048738.808113:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1789048738.808125:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1789048738.808139:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1789048738.808152:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1789048738.808165:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1789048738.808179:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1789048738.808192:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1789048738.808205:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1789048738.808219:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1789048738.808232:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1789048738.808247:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1789048738.808290:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111448064:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048738.808368:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048738.808471:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11507300 going to sleep for 11 seconds 00000100:00100000:3.0:1789048738.808564:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111448064 00000100:00100000:3.0:1789048738.808572:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111448064 00000100:00100000:3.0:1789048738.808604:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789048738.808612:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c489050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+15:17855:x1875953111448064:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048738.808728:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c489050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+15:17855:x1875953111448064:12345-0@lo:502:mount.lustre.0 Request processed in 115us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048738.808735:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789048738.808996:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111448064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789048738.809044:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1789048738.809053:0:17855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1789048738.809679:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048738.809689:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048738.809692:0:17859:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789048738.809697:0:17859:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1789048738.809700:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789048738.809777:0:17859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff959c3ef799c0) 00000020:00000080:0.0:1789048738.809796:0:17859:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1789048738.809802:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789048738.809967:0:17859:0:(osd_handler.c:8921:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789048738.809974:0:17859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x133f221c08777030 00000020:00000080:0.0:1789048738.810200:0:17859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789048738.810205:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048738.810209:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048738.810210:0:17859:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789048738.810213:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048738.810218:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048738.810219:0:17859:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1789048738.810222:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789048738.810230:0:17859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff959c3ef7cd40) 00000020:00000080:0.0:1789048738.810241:0:17859:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1789048738.810246:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789048738.810248:0:17859:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1789048738.810251:0:17859:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1789048738.810256:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789048738.810300:0:17859:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c08aff800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1789048738.810312:0:17859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff959c3ef78000) 00000020:00000080:0.0:1789048738.810320:0:17859:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1789048738.810526:0:17859:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789048738.810532:0:17859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x133f221c08777045 00000020:00000080:0.0:1789048738.810623:0:17859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789048738.810630:0:17859:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789048738.810635:0:17859:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x133f221c0877704c 00080000:01000000:0.0:1789048738.810641:0:17859:0:(osd_handler.c:8921:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789048738.810644:0:17859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x133f221c08777053 00010000:00010000:2.0:1789048738.867562:0:17859:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789048738.868113:0:17859:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1789048738.868499:0:17859:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789048738.870292:0:17859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789048738.870305:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789048738.870312:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048738.870314:0:17859:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1789048738.870317:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789048738.870323:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048738.870324:0:17859:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1789048738.870327:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789048738.870363:0:17859:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:00000080:2.0:1789048738.870388:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789048738.870401:0:17859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff959b07923380) 00000020:00000080:2.0:1789048738.870423:0:17859:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1789048738.870430:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789048738.870495:0:17859:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1789048738.870502:0:17859:0:(osd_handler.c:8921:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789048738.870510:0:17859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x133f221c08777061 00010000:00080000:2.0:1789048738.870542:0:17859:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959c414c7800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:2.0:1789048738.872186:0:17859:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1789048738.876059:0:17859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789048738.876080:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789048738.876116:0:17859:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789048738.876139:0:17859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x133f221c08777068 00000100:00080000:2.0:1789048738.876149:0:17859:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789048738.876160:0:17859:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff959c414c7800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048738.876195:0:17859:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c08a8e300 x1875953111448192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789048738.876222:0:17859:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1789048738.876270:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789048738.876274:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048738.876276:0:17859:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1789048738.876279:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789048738.876282:0:17859:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789048738.876283:0:17859:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789048738.876284:0:17859:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789048738.876286:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789048738.876289:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048738.876290:0:17859:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789048738.876292:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789048738.876297:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048738.876298:0:17859:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1789048738.876301:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789048738.876329:0:17859:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789048738.876362:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789048738.876366:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048738.876368:0:17859:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1789048738.876371:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789048738.876373:0:17859:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1789048738.876374:0:17859:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789048738.876375:0:17859:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789048738.876377:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789048738.876379:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048738.876385:0:17859:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789048738.876388:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789048738.876392:0:17859:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789048738.876395:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048738.876396:0:17859:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789048738.876399:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789048738.876402:0:17859:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:2.0:1789048738.876423:0:17859:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789048738.876426:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789048738.876438:0:17859:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff959b07924d40) 00000020:00000080:2.0:1789048738.876450:0:17859:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789048738.876454:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789048738.876509:0:17859:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1789048738.876515:0:17859:0:(osd_handler.c:8921:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789048738.876521:0:17859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x133f221c08777076 00010000:00080000:2.0:1789048738.876547:0:17859:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959c414c0800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.116@tcp at head 00000100:00080000:1.0:1789048738.877847:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789048738.877855:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789048738.877868:0:8:0:(import.c:65:import_set_state_nolock()) ffff959c03136800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789048738.877874:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:1.0:1789048738.877878:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789048738.877886:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff959c03136800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048738.877911:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fb9d880 x1875953111448320/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789048738.877925:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048738.877928:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789048738.877930:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048738.877933:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789048738.877980:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111448448:0@lo:400:kworker.0 00000100:00100000:1.0:1789048738.878051:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048738.878120:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111448448 00000100:00100000:1.0:1789048738.878128:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111448448 00000100:00100000:1.0:1789048738.878169:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789048738.878177:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111448448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048738.878225:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111448448:12345-0@lo:400:kworker.0 Request processed in 48us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048738.878232:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789048738.878267:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff959c3fb9df80 x1875953111448448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048738.878280:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111448448:0@lo:400:kworker.0 00000100:00100000:1.0:1789048738.878321:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111448192:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789048738.878375:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048738.878399:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111448320:0@lo:38:kworker.0 00000100:00100000:1.0:1789048738.878433:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048738.878460:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111448192 00000100:00100000:1.0:1789048738.878463:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111448192 00000100:00100000:1.0:1789048738.878473:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111448320 00000100:00100000:1.0:1789048738.878475:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111448320 00000100:00100000:1.0:1789048738.878482:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789048738.878487:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875953111448192:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789048738.878506:0:17127:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:1.0:1789048738.878538:0:17127:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x133f221c0877707d 00000004:00100000:1.0:1789048738.878551:0:17127:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789048738.878556:0:17127:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1789048738.878956:0:17859:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:3.0:1789048738.880364:0:17859:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789048738.880589:0:17859:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789048738.882851:0:17859:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789048738.883082:0:17859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789048738.883245:0:17859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:1.0:1789048738.884362:0:17864:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789048738.884376:0:17864:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00080000:2.0:1789048738.884545:0:17127:0:(import.c:65:import_set_state_nolock()) ffff959c414c6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789048738.884652:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1875953111448192:12345-0@lo:38:llog_process_th.0 Request processed in 6161us (6274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048738.884664:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789048738.884697:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789048738.884703:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875953111448320:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1789048738.884832:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875953111448320:12345-0@lo:38:kworker.0 Request processed in 128us (6398us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789048738.884839:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789048738.884960:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789048738.884969:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789048738.884977:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2408010450010a0 00000100:00080000:1.0:1789048738.884982:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789048738.884984:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c414c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789048738.884997:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111448192:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789048738.885008:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789048738.885012:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c03136800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789048738.885015:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789048738.885018:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111448320:0@lo:38:kworker.0 00000100:00100000:1.0:1789048738.885081:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789048738.885093:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111448576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048738.885131:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048738.885161:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111448576 00000100:00100000:1.0:1789048738.885167:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111448576 00000100:00100000:1.0:1789048738.885195:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789048738.885202:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3623:x1875953111448576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789048738.885226:0:17128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789048738.885319:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3623:x1875953111448576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048738.885326:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789048738.885381:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111448576:0@lo:41:osp-pre-0-1.0 00000020:00000080:2.0:1789048738.888903:0:17859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789048738.888919:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789048738.888965:0:17859:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789048738.888990:0:17859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x133f221c08777084 00000100:00080000:2.0:1789048738.889007:0:17859:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789048738.889020:0:17859:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff959c414c0800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048738.889058:0:17859:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c08a8c380 x1875953111448704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789048738.889087:0:17859:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789048738.889148:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789048738.889153:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048738.889154:0:17859:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789048738.889157:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789048738.889160:0:17859:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1789048738.889161:0:17859:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789048738.889162:0:17859:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789048738.889163:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789048738.889166:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048738.889167:0:17859:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789048738.889169:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789048738.889173:0:17859:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789048738.889176:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048738.889177:0:17859:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789048738.889179:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789048738.889183:0:17859:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:2.0:1789048738.889204:0:17859:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789048738.889207:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789048738.889219:0:17859:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff959c394bb380) 00000020:00000080:2.0:1789048738.889232:0:17859:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1789048738.889237:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789048738.889292:0:17859:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789048738.889300:0:17859:0:(osd_handler.c:8921:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789048738.889306:0:17859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x133f221c08777092 00010000:00080000:2.0:1789048738.889361:0:17859:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959b0833b800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:2.0:1789048738.889559:0:17859:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789048738.889641:0:17859:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789048738.889657:0:17859:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1789048738.889865:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111448704:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789048738.889921:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875953111448704 offset 0 length 520: 4 00000100:00080000:3.0:1789048738.890284:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789048738.890290:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789048738.890292:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789048738.890295:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1789048738.892037:0:17859:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789048738.892234:0:17859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789048738.892455:0:17859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789048738.893894:0:17866:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789048738.893900:0:17866:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789048738.899043:0:17859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789048738.899058:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789048738.899107:0:17859:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789048738.899131:0:17859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x133f221c08777099 00000100:00080000:3.0:1789048738.899141:0:17859:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789048738.899154:0:17859:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff959b0833b800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048738.899191:0:17859:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b08844e00 x1875953111448832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789048738.899211:0:17859:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789048738.899275:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048738.899279:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048738.899295:0:17859:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789048738.899298:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048738.899302:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048738.899303:0:17859:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789048738.899305:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789048738.899307:0:17859:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789048738.899309:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048738.899312:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048738.899313:0:17859:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789048738.899315:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048738.899317:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048738.899318:0:17859:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789048738.899322:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789048738.899380:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048738.899383:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048738.899385:0:17859:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789048738.899388:0:17859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:1.0:1789048738.899561:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048738.899566:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789048738.899575:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048738.899578:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789048738.899656:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111448832:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789048738.899705:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875953111448832 offset 0 length 520: 4 00000020:01000000:3.0:1789048738.901500:0:17855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1789048738.901545:0:17855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789048738.901572:0:17855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08364600/0x133f221c0877701b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777022 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048738.901585:0:17855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b08364600/0x133f221c0877701b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777022 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048738.901593:0:17855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c08aff800 from 1 10000000:01000000:3.0:1789048738.901596:0:17855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789048738.901629:0:17855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c400/0x133f221c087770a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048738.901636:0:17855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c400/0x133f221c087770a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048738.901658:0:17855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c400/0x133f221c087770a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048738.901678:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08847100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111448960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789048738.901820:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048738.901930:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa6600 going to sleep for 11 seconds 00000100:00100000:3.0:1789048738.901956:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111448960 00000100:00100000:3.0:1789048738.901963:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111448960 00000100:00100000:3.0:1789048738.902005:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789048738.902014:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+15:17855:x1875953111448960:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789048738.902027:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048738.902041:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef3c000/0x133f221c087770a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087770a0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048738.902062:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3c000/0x133f221c087770a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087770a0 expref: 16 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048738.902072:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef3c000/0x133f221c087770a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087770a0 expref: 16 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048738.902080:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3c000, rc 0) 00000100:00100000:3.0:1789048738.902116:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+16:17855:x1875953111448960:12345-0@lo:101:mount.lustre.0 Request processed in 104us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048738.902123:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789048738.902167:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08847100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111448960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789048738.902181:0:17855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c400/0x133f221c087770a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087770a7 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048738.902196:0:17855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c400/0x133f221c087770a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087770a7 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048738.903870:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08847100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111449088:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789048738.903935:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048738.904013:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111449088 00000100:00100000:0.0:1789048738.904020:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111449088 00000100:00100000:0.0:1789048738.904062:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789048738.904070:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+16:17855:x1875953111449088:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789048738.904089:0:17115:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789048738.904108:0:17115:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789048738.904112:0:17115:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789048738.904187:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+16:17855:x1875953111449088:12345-0@lo:256:mount.lustre.0 Request processed in 117us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048738.904194:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789048738.904669:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa6600 going to sleep for 11 seconds 00000100:00100000:3.0:1789048738.904693:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08847100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111449088:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789048738.905435:0:17855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789048738.905450:0:17855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c400/0x133f221c087770a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087770a7 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048738.905462:0:17855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c400/0x133f221c087770a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087770a7 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048738.905471:0:17855:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c08aff800 from 1 10000000:01000000:3.0:1789048738.905474:0:17855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789048738.905505:0:17855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d200/0x133f221c087770ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048738.905513:0:17855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d200/0x133f221c087770ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048738.905523:0:17855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d200/0x133f221c087770ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048738.905542:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08847100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111449216:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789048738.905588:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048738.905630:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa6600 going to sleep for 11 seconds 00000100:00100000:0.0:1789048738.905739:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111449216 00000100:00100000:0.0:1789048738.905745:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111449216 00000100:00100000:0.0:1789048738.905796:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789048738.905815:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+16:17855:x1875953111449216:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789048738.905827:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048738.905840:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b08364400/0x133f221c087770b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087770ae expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048738.906022:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b08364400/0x133f221c087770b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087770ae expref: 17 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048738.906043:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b08364400/0x133f221c087770b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087770ae expref: 17 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048738.906051:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08364400, rc 0) 00000100:00100000:0.0:1789048738.906097:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:17855:x1875953111449216:12345-0@lo:101:mount.lustre.0 Request processed in 293us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048738.906104:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789048738.906259:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08847100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111449216:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789048738.906275:0:17855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d200/0x133f221c087770ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087770b5 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048738.906284:0:17855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d200/0x133f221c087770ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087770b5 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789048738.906452:0:17855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789048738.906482:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08847100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111449344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048738.906506:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048738.906528:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa6240 going to sleep for 11 seconds 00000100:00100000:2.0:1789048738.906580:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111449344 00000100:00100000:2.0:1789048738.906584:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111449344 00000100:00100000:2.0:1789048738.906618:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789048738.906626:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:17855:x1875953111449344:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048738.906695:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:17855:x1875953111449344:12345-0@lo:501:mount.lustre.0 Request processed in 70us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048738.906702:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789048738.906942:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08847100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111449344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048738.906971:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111449472:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789048738.907009:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048738.907033:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11507240 going to sleep for 11 seconds 00000100:00100000:2.0:1789048738.907082:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111449472 00000100:00100000:2.0:1789048738.907086:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111449472 00000100:00100000:2.0:1789048738.907116:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789048738.907123:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:17855:x1875953111449472:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789048738.907201:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:17855:x1875953111449472:12345-0@lo:503:mount.lustre.0 Request processed in 78us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048738.907208:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789048738.907281:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111449472:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789048738.907645:0:17855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789048738.907797:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111449600:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048738.907847:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048738.908004:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11507240 going to sleep for 11 seconds 00000100:00100000:3.0:1789048738.908144:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111449600 00000100:00100000:3.0:1789048738.908148:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111449600 00000100:00100000:3.0:1789048738.908215:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789048738.908224:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:17855:x1875953111449600:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048738.908323:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:17855:x1875953111449600:12345-0@lo:502:mount.lustre.0 Request processed in 100us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048738.908330:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789048738.908471:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111449600:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789048738.908679:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789048738.908720:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1789048738.908741:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1789048738.908758:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1789048738.908773:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1789048738.908789:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1789048738.908803:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1789048738.908833:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1789048738.908849:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789048738.908878:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1789048738.908894:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1789048738.908920:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111449728:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789048738.908958:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048738.908991:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef213c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048738.909156:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111449728 00000100:00100000:3.0:1789048738.909161:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111449728 00000100:00100000:3.0:1789048738.909184:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789048738.909191:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:17855:x1875953111449728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048738.909269:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:17855:x1875953111449728:12345-0@lo:502:mount.lustre.0 Request processed in 78us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048738.909275:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789048738.909631:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111449728:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789048738.909675:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1789048738.909684:0:17855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789048738.910522:0:17868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048738.910537:0:17868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048738.910540:0:17868:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789048738.910547:0:17868:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959c08aff800 00000020:00000080:3.0:1789048738.910549:0:17868:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789048738.910555:0:17868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048738.910557:0:17868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048738.910558:0:17868:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789048738.910561:0:17868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048738.910563:0:17868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048738.910564:0:17868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789048738.910567:0:17868:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959c08aff800 00000020:00000080:3.0:1789048738.910568:0:17868:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789048738.910650:0:17868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048738.910654:0:17868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048738.910656:0:17868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789048738.910658:0:17868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048738.910660:0:17868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048738.910662:0:17868:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789048738.910665:0:17868:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959c08aff800 00000020:00000080:3.0:1789048738.910667:0:17868:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789048738.914138:0:17868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048738.914151:0:17868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048738.914153:0:17868:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789048738.914158:0:17868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048738.914163:0:17868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048738.914164:0:17868:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789048738.914169:0:17868:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959c08aff800 00000020:00000080:3.0:1789048738.914172:0:17868:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789048738.914231:0:17868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048738.914235:0:17868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048738.914236:0:17868:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789048738.914240:0:17868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1789048738.916075:0:17855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789048738.916117:0:17855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789048738.916148:0:17855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d200/0x133f221c087770ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087770b5 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048738.916163:0:17855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d200/0x133f221c087770ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087770b5 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048738.916239:0:17855:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789048738.916243:0:17855:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff959c08aff800 10000000:01000000:1.0:1789048738.916246:0:17855:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff959c08aff800 10000000:01000000:1.0:1789048738.916250:0:17855:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789048738.916257:0:17855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959c08aff800 from 1 10000000:01000000:1.0:1789048738.916259:0:17855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789048738.916296:0:17855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba0c00/0x133f221c087770bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048738.916304:0:17855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b07ba0c00/0x133f221c087770bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048738.916315:0:17855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b07ba0c00/0x133f221c087770bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048738.916367:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111449856:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789048738.916434:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048738.916472:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41497d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789048738.920065:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111449856 00000100:00100000:3.0:1789048738.920080:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111449856 00000100:00100000:3.0:1789048738.920146:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789048738.920156:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:17855:x1875953111449856:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789048738.920174:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048738.920192:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef3d400/0x133f221c087770c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087770bc expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048738.920222:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3d400/0x133f221c087770c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087770bc expref: 18 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048738.920234:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef3d400/0x133f221c087770c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087770bc expref: 18 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048738.920244:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3d400, rc 0) 00000100:00100000:3.0:1789048738.920319:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:17855:x1875953111449856:12345-0@lo:101:mount.lustre.0 Request processed in 165us (3885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048738.920327:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789048738.920426:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111449856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789048738.920444:0:17855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b07ba0c00/0x133f221c087770bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087770c3 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048738.920454:0:17855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b07ba0c00/0x133f221c087770bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087770c3 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789048738.924677:0:17855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1789048738.925002:0:17855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789048738.925178:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789048738.925206:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1789048738.925222:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1789048738.925238:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1789048738.925264:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1789048738.925280:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1789048738.925294:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1789048738.925309:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1789048738.925325:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1789048738.925368:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1789048738.925401:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1789048738.925417:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1789048738.925431:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1789048738.925445:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1789048738.925460:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1789048738.925476:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1789048738.925490:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1789048738.925506:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1789048738.925522:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1789048738.925538:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1789048738.925553:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1789048738.925567:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1789048738.925583:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1789048738.925599:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1789048738.925628:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1789048738.925641:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1789048738.925652:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1789048738.925661:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1789048738.925676:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1789048738.925680:0:17855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1789048738.925758:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111449984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048738.925834:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048738.925875:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048738.926214:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111449984 00000100:00100000:0.0:1789048738.926222:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111449984 00000100:00100000:0.0:1789048738.926271:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789048738.926280:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:17855:x1875953111449984:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048738.926412:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:17855:x1875953111449984:12345-0@lo:501:mount.lustre.0 Request processed in 133us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048738.926420:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789048738.926465:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111449984:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048738.926509:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111450112:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789048738.926545:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048738.926563:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111450112 00000100:00100000:0.0:1789048738.926567:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111450112 00000100:00100000:0.0:1789048738.926585:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789048738.926591:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:17855:x1875953111450112:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789048738.926656:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:17855:x1875953111450112:12345-0@lo:503:mount.lustre.0 Request processed in 65us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048738.926663:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789048738.926694:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c42b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789048738.926705:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111450112:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789048738.930388:0:17855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789048738.930492:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111450240:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048738.930569:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048738.930611:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111450240 00000100:00100000:0.0:1789048738.930618:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111450240 00000100:00100000:0.0:1789048738.930658:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789048738.930667:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:17855:x1875953111450240:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048738.930766:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:17855:x1875953111450240:12345-0@lo:502:mount.lustre.0 Request processed in 100us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048738.930774:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789048738.930839:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c42b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789048738.936959:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111450240:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789048738.937271:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1789048738.937305:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1789048738.937352:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1789048738.937386:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1789048738.937404:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1789048738.937419:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1789048738.937434:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1789048738.937448:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1789048738.937463:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1789048738.937477:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1789048738.937490:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1789048738.937504:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1789048738.937518:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1789048738.937533:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1789048738.937549:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1789048738.937562:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1789048738.937576:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1789048738.937591:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1789048738.937606:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1789048738.937633:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1789048738.937654:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1789048738.937670:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1789048738.937685:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1789048738.937701:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1789048738.937715:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1789048738.937730:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1789048738.937745:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1789048738.937760:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1789048738.937773:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1789048738.937787:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1789048738.937801:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1789048738.937830:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1789048738.937844:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1789048738.937941:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1789048738.937961:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1789048738.937998:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1789048738.938013:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1789048738.938024:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1789048738.938034:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1789048738.938043:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1789048738.938053:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1789048738.938063:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1789048738.938074:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1789048738.938086:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1789048738.938097:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1789048738.938106:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1789048738.938116:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1789048738.938126:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1789048738.938172:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111450368:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048738.938245:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048738.938299:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111450368 00000100:00100000:0.0:1789048738.938306:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111450368 00000100:00100000:0.0:1789048738.938373:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789048738.938382:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:17855:x1875953111450368:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048738.938494:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:17855:x1875953111450368:12345-0@lo:502:mount.lustre.0 Request processed in 113us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048738.938502:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789048738.938557:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c42b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789048738.938577:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111450368:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789048738.938739:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1789048738.938761:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1789048738.938782:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111450496:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048738.938831:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048738.939024:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111450496 00000100:00100000:0.0:1789048738.939029:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111450496 00000100:00100000:0.0:1789048738.939777:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789048738.939789:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3291b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:17855:x1875953111450496:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048738.939914:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3291b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:17855:x1875953111450496:12345-0@lo:502:mount.lustre.0 Request processed in 127us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048738.939921:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789048738.942038:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c42b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789048738.942083:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111450496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789048738.942197:0:17855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1789048738.942213:0:17855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789048738.943420:0:17873:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1789048738.943439:0:17873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff959c394b8000) 00000020:00000080:2.0:1789048738.943462:0:17873:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789048738.943558:0:17873:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c08aff800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789048738.943562:0:17873:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959c08aff800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789048738.943565:0:17873:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c08aff800 3 00010000:00080000:2.0:1789048738.943595:0:17873:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959b081c7800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:2.0:1789048738.947176:0:17873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1789048738.950571:0:17873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1789048738.950630:0:17873:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789048738.950645:0:17873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x133f221c087770d1 00000100:00080000:1.0:1789048738.950655:0:17873:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789048738.950667:0:17873:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff959b081c7800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048738.950701:0:17873:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fb9e300 x1875953111450624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789048738.958186:0:17873:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1789048738.961386:0:17873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1789048738.961637:0:17855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789048738.961670:0:17855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789048738.961688:0:17855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba0c00/0x133f221c087770bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087770c3 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.961701:0:17855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b07ba0c00/0x133f221c087770bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087770c3 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789048738.961760:0:17855:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789048738.961763:0:17855:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789048738.961764:0:17855:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048738.961765:0:17855:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048738.961766:0:17855:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048738.961768:0:17855:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048738.961769:0:17855:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789048738.961771:0:17855:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048738.961772:0:17855:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789048738.961776:0:17855:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1789048738.961779:0:17855:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789048738.961780:0:17855:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789048738.961781:0:17855:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048738.961782:0:17855:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048738.961783:0:17855:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048738.961785:0:17855:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048738.961786:0:17855:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789048738.961787:0:17855:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048738.961788:0:17855:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789048738.961824:0:17855:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789048738.961845:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111450752:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789048738.961981:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048738.962026:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06980300 going to sleep for 11 seconds 00000100:00100000:1.0:1789048738.963021:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111450752 00000100:00100000:1.0:1789048738.963030:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111450752 00000100:00100000:1.0:1789048738.963207:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789048738.963219:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32918c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:17855:x1875953111450752:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789048738.963249:0:17115:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789048738.963262:0:17115:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1789048738.967039:0:17102:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789048738.968451:0:17115:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789048738.968473:0:17115:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789048738.968780:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32918c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:17855:x1875953111450752:12345-0@lo:253:mount.lustre.0 Request processed in 5560us (6795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048738.968793:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789048738.969230:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875953111450624:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789048738.969277:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048738.969374:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111450624 00000100:00100000:0.0:1789048738.969381:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111450624 00000100:00100000:0.0:1789048738.969414:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789048738.969421:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111450624:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789048738.969446:0:17122:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:0.0:1789048738.969481:0:17122:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x133f221c087770d8 20000000:01000000:2.0:1789048738.971280:0:17138:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789048738.971290:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789048738.971315:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff959c04cb1000/0x133f221c087770df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.971363:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959b08364800/0x133f221c08776fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08776fdc expref: 17 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.971371:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c3ef3c000/0x133f221c087770a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087770a0 expref: 17 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.971378:0:17138:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959c04cb1000/0x133f221c087770df lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.971419:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c3ef3c000/0x133f221c087770a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c087770a0 expref: 17 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.971436:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c3ef3c000/0x133f221c087770a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c087770a0 expref: 17 pid: 17116 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048738.971450:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1875953111450880:0@lo:104: 00000100:00100000:2.0:1789048738.971502:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789048738.971548:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959b08364800/0x133f221c08776fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08776fdc expref: 17 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.971556:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959b08364800/0x133f221c08776fe3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08776fdc expref: 17 pid: 17117 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048738.971564:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1875953111451008:0@lo:104: 00000100:00100000:2.0:1789048738.971583:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048738.974921:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06980b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789048738.974974:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111450880 00000100:00100000:2.0:1789048738.974983:0:17106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111450880 00000100:00100000:2.0:1789048738.975015:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111451008 00000100:00100000:2.0:1789048738.975029:0:17106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111451008 00000100:00100000:2.0:1789048738.975051:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789048738.975059:0:17106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+4:17138:x1875953111450880:12345-0@lo:104: 00010000:00010000:2.0:1789048738.975074:0:17106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c400/0x133f221c087770a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087770a7 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975146:0:17106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789048738.975151:0:17106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+4:17138:x1875953111450880:12345-0@lo:104: Request processed in 93us (3649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048738.975158:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789048738.975175:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789048738.975181:0:17106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+3:17138:x1875953111451008:12345-0@lo:104: 00010000:00010000:2.0:1789048738.975189:0:17106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959b07ba0000/0x133f221c08776fdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08776fe3 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975225:0:17106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789048738.975230:0:17106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+3:17138:x1875953111451008:12345-0@lo:104: Request processed in 50us (3646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048738.975236:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789048738.975266:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789048738.975272:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c400/0x133f221c087770a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087770a7 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975280:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c400 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048738.975285:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c400/0x133f221c087770a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c087770a7 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975294:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c400/0x133f221c087770a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c087770a7 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048738.975314:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c400/0x133f221c087770a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c087770a7 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048738.975320:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789048738.975368:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c400/0x133f221c087770a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087770a7 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975374:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048738.975397:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c400/0x133f221c087770a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087770a7 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975405:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c400/0x133f221c087770a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087770a7 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975417:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048738.975421:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959b07ba0000/0x133f221c08776fdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08776fe3 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975426:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0000 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048738.975430:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959b07ba0000/0x133f221c08776fdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08776fe3 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975436:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959b07ba0000/0x133f221c08776fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08776fe3 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048738.975443:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959b07ba0000/0x133f221c08776fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08776fe3 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048738.975448:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789048738.975468:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959b07ba0000/0x133f221c08776fdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08776fe3 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975474:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048738.975491:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959b07ba0000/0x133f221c08776fdc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08776fe3 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975498:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959b07ba0000/0x133f221c08776fdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08776fe3 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975513:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048738.975515:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048738.975517:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048738.975539:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111451136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048738.975575:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048738.975607:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111451264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048738.975629:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048738.975657:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111451136 00000100:00100000:2.0:1789048738.975661:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111451136 00010000:00010000:2.0:1789048738.975680:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c3ef3c000/0x133f221c087770a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087770a0 expref: 18 pid: 17116 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048738.975700:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111451264 00000100:00100000:2.0:1789048738.975703:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111451264 00010000:00010000:2.0:1789048738.975714:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959b08364800/0x133f221c08776fe3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08776fdc expref: 19 pid: 17117 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048738.975726:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789048738.975732:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+19:3623:x1875953111451136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048738.975741:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048738.975752:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c3ef3c000/0x133f221c087770a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087770a0 expref: 19 pid: 17116 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975763:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c3ef3c000/0x133f221c087770a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c087770a0 expref: 19 pid: 17116 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975778:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048738.975821:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+19:3623:x1875953111451136:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048738.975828:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789048738.975841:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789048738.975848:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:3620:x1875953111451264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048738.975855:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048738.975860:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959b08364800/0x133f221c08776fe3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08776fdc expref: 18 pid: 17117 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975868:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959b08364800/0x133f221c08776fe3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08776fdc expref: 18 pid: 17117 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975880:0:17107:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959c04cb1000/0x133f221c087770df lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975888:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c04cb1000/0x133f221c087770df lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789048738.975902:0:17107:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006217463s 00010000:00010000:2.0:1789048738.975907:0:17107:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c04cb1000/0x133f221c087770df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975914:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c04cb1000/0x133f221c087770df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975931:0:17107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff959c04cb1000/0x133f221c087770df lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975937:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff959c04cb1000/0x133f221c087770df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975942:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1000 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048738.975945:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff959c04cb1000/0x133f221c087770df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975953:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff959c04cb1000/0x133f221c087770df lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975962:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff959c04cb1000/0x133f221c087770df lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.975971:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048738.976000:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:3620:x1875953111451264:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048738.976006:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789048738.976045:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111451264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048738.976067:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111451136:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048738.976086:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3c000/0x133f221c087770a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c087770a0 expref: 17 pid: 17116 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048738.976096:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1875953111450880:0@lo:104: 00010000:00010000:2.0:1789048738.976105:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b08364800/0x133f221c08776fe3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08776fdc expref: 16 pid: 17117 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048738.976120:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1875953111451008:0@lo:104: 00010000:00010000:2.0:1789048738.976135:0:17138:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff959c04cb1000/0x133f221c087770df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.976143:0:17138:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff959c04cb1000/0x133f221c087770df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.976148:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff959c04cb1000/0x133f221c087770df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048738.976154:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c04cb1000/0x133f221c087770df lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048738.976203:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17855:1875953111450752:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789048738.976212:0:17855:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789048738.976216:0:17855:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789048738.976217:0:17855:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789048738.976218:0:17855:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048738.976220:0:17855:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048738.976221:0:17855:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048738.976222:0:17855:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048738.976224:0:17855:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789048738.976226:0:17855:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048738.976227:0:17855:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789048738.976240:0:17855:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1789048738.978020:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00100000:0.0:1789048738.978071:0:17122:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789048738.978117:0:17122:0:(import.c:65:import_set_state_nolock()) ffff959c08adf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789048738.978197:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875953111450624:12345-0@lo:38:llog_process_th.0 Request processed in 8774us (8918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048738.978207:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789048738.978251:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff959c3fb9e300 x1875953111450624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789048748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048738.978262:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789048738.978270:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789048738.978277:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789048738.978293:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789048738.978296:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b081c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789048738.978302:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875953111450624:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789048738.983412:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789048738.983422:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789048738.983430:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789048738.983434:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:01000000:2.0:1789048738.998038:0:17855:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1789048738.998174:0:17880:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789048738.998178:0:17880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789048738.998254:0:17881:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1789048738.998671:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789048739.000532:0:17881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789048739.000603:0:17881:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 1, retries 0 00000040:01000000:2.0:1789048739.001067:0:17855:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1789048739.001423:0:17882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17882:1875953111451392:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789048739.001509:0:17882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048739.001556:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111451392 00000100:00100000:2.0:1789048739.001570:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111451392 00000100:00100000:2.0:1789048739.001614:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789048739.001622:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17882:x1875953111451392:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789048739.001692:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17882:x1875953111451392:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 70us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048739.001699:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789048739.001726:0:17882:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2b221840 going to sleep for 11 seconds 00000100:00100000:2.0:1789048739.001748:0:17882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17882:1875953111451392:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1789048739.001774:0:17882:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789048739.001799:0:17882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17882:1875953111451520:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789048739.001839:0:17882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:0.0:1789048739.002067:0:17855:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1789048739.002106:0:17855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789048739.002616:0:17855:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789048739.002624:0:17855:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1789048739.002661:0:17855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789048739.003644:0:17855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1789048739.003969:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111451520 00000100:00100000:2.0:1789048739.003979:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111451520 00000100:00100000:2.0:1789048739.004028:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789048739.004038:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17882:x1875953111451520:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789048739.004181:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17882:x1875953111451520:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 144us (2340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048739.004189:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789048739.004218:0:17882:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2b221840 going to sleep for 11 seconds 00000100:00100000:2.0:1789048739.004238:0:17882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17882:1875953111451520:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789048739.004304:0:17882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17882:1875953111451648:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789048739.004354:0:17882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048739.004391:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111451648 00000100:00100000:2.0:1789048739.004395:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111451648 00000100:00100000:2.0:1789048739.004419:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789048739.004426:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17882:x1875953111451648:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789048739.004466:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17882:x1875953111451648:12345-0@lo:900:lod0001_rec0000.0 Request processed in 41us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048739.004473:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789048739.004498:0:17882:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2b221600 going to sleep for 11 seconds 00010000:00080000:2.0:1789048739.004512:0:17882:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff959c08a8d180 x1875953111451648/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789048755 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048739.004522:0:17882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17882:1875953111451648:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789048739.004564:0:17882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17882:1875953111451776:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789048739.004597:0:17882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048739.004614:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111451776 00000100:00100000:2.0:1789048739.004618:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111451776 00000100:00100000:2.0:1789048739.004635:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789048739.004640:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17882:x1875953111451776:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789048739.004677:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17882:x1875953111451776:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 37us (80us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048739.004683:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789048739.004699:0:17882:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2b221840 going to sleep for 11 seconds 00000100:00100000:2.0:1789048739.004710:0:17882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17882:1875953111451776:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1789048739.004746:0:17882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789048739.007075:0:17855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:00080000:2.0:1789048739.008451:0:17882:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789048739.008512:0:17882:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789048739.008517:0:17882:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:01000000:3.0:1789048739.008936:0:17855:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789048739.009114:0:17855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789048739.010109:0:17855:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:2.0:1789048739.012178:0:17855:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789048739.029506:0:17855:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789048739.029545:0:17855:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb770c1863988 00100000:10000000:2.0:1789048739.029563:0:17855:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789048739.030625:0:17855:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789048739.030661:0:17855:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789048739.030684:0:17855:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789048739.030701:0:17855:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789048739.035480:0:17855:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789048739.035712:0:17855:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789048739.421577:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048739.805430:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 00000040:00080000:1.0:1789048740.002106:0:17877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1789048740.420263:0:17119:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789048740.420270:0:17119:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c08aff800 from 8 10000000:01000000:0.0:1789048740.420275:0:17119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789048740.420314:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087770e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048740.420353:0:17119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087770e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048740.421943:0:17119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087770e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048740.421979:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111451904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789048740.422124:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048740.422186:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06aa6780 going to sleep for 11 seconds 00000100:00100000:3.0:1789048740.423838:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111451904 00000100:00100000:3.0:1789048740.423859:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111451904 00000100:00100000:3.0:1789048740.423913:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789048740.423923:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3291ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+16:17119:x1875953111451904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048740.423940:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048740.423959:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef3ce00/0x133f221c087770ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087770e6 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048740.423986:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3ce00/0x133f221c087770ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087770e6 expref: 17 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048740.423996:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef3ce00/0x133f221c087770ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087770e6 expref: 17 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048740.424004:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3ce00, rc 0) 00000100:00100000:3.0:1789048740.424207:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3291ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:17119:x1875953111451904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 285us (2083us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048740.424226:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789048740.424287:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111451904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048740.424304:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087770e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087770ed expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048740.424314:0:17119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087770e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087770ed expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048740.425127:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08846a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111452032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789048740.425179:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048740.425214:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11507240 going to sleep for 11 seconds 00000100:00100000:1.0:1789048740.426642:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111452032 00000100:00100000:1.0:1789048740.426653:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111452032 00000100:00100000:1.0:1789048740.426708:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789048740.426719:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32919050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:17119:x1875953111452032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789048740.426742:0:17115:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789048740.426761:0:17115:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789048740.426764:0:17115:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789048740.428319:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32919050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:17119:x1875953111452032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1595us (3133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048740.428357:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789048740.428426:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08846a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111452032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789048740.429724:0:17119:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789048740.429745:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087770e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087770ed expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048740.429758:0:17119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087770e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087770ed expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048740.429769:0:17119:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789048740.429772:0:17119:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c04ca4000 from 8 10000000:01000000:1.0:1789048740.430615:0:17119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789048740.430653:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c087770f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048740.430663:0:17119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c087770f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048740.430673:0:17119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c087770f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048740.430695:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111452160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789048740.430750:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048740.431150:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0793acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048740.435952:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111452160 00000100:00100000:3.0:1789048740.435967:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111452160 00000100:00100000:3.0:1789048740.436199:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789048740.436210:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:17119:x1875953111452160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048740.436226:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048740.436242:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef3c200/0x133f221c087770fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087770f4 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048740.436268:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3c200/0x133f221c087770fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087770f4 expref: 18 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048740.436279:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef3c200/0x133f221c087770fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087770f4 expref: 18 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048740.436288:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3c200, rc 0) 00000100:00100000:3.0:1789048740.436396:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:17119:x1875953111452160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (5645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048740.436411:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789048740.436513:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111452160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048740.436532:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c087770f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087770fb expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048740.436542:0:17119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c087770f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087770fb expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048740.436603:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111452288:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789048740.436648:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048740.441588:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0793acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048740.444268:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111452288 00000100:00100000:0.0:1789048740.444283:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111452288 00000100:00100000:0.0:1789048740.444352:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789048740.444373:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3291bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:17119:x1875953111452288:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789048740.444420:0:17116:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789048740.444436:0:17116:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789048740.444439:0:17116:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789048740.444656:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3291bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:17119:x1875953111452288:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 295us (8006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048740.444663:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789048740.449391:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111452288:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789048740.449460:0:17119:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789048740.449604:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c087770f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087770fb expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048740.449619:0:17119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c087770f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087770fb expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048740.449982:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048740.829414:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 00000040:00080000:1.0:1789048741.023943:0:17877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789048741.470513:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048741.855636:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 00010000:00010000:0.0:1789048742.493506:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048742.880217:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 00010000:00010000:0.0:1789048743.520883:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048743.911844:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111452416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048743.911938:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048743.923231:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111452416 00000100:00100000:1.0:1789048743.923252:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111452416 00000100:00100000:1.0:1789048743.923321:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789048743.923349:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111452416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789048743.923388:0:17128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789048743.923486:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111452416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 155us (11547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048743.923493:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789048743.923611:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111452416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048743.929918:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 0 seconds 00000100:00080000:1.0:1789048744.424245:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789048744.424252:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789048744.424256:0:8:0:(import.c:65:import_set_state_nolock()) ffff959c03136800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789048744.424271:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff959c03136800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048744.424290:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fb9c000 x1875953111452672/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789048744.424313:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048744.424317:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789048744.424319:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048744.424322:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789048744.424362:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048744.424365:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789048744.424367:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048744.424370:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789048744.424398:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111452672:0@lo:38:kworker.0 00000100:00100000:1.0:1789048744.424461:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048744.424521:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111452928:0@lo:400:kworker.0 00000100:00100000:1.0:1789048744.424543:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048744.424558:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789048744.424563:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111453056:0@lo:400:kworker.0 00000100:00100000:1.0:1789048744.424585:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048744.424611:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111452672 00000100:00100000:1.0:1789048744.424619:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111452672 00000100:00100000:1.0:1789048744.424639:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111452928 00000100:00100000:1.0:1789048744.424641:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111452928 00000100:00100000:1.0:1789048744.424661:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789048744.424667:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3619:x1875953111452672:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789048744.424691:0:17128:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:1.0:1789048744.424722:0:17128:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x133f221c08777102 00000004:00100000:1.0:1789048744.424740:0:17128:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789048744.424746:0:17128:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1789048744.424835:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111453056 00000100:00100000:1.0:1789048744.424839:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111453056 00000100:00100000:1.0:1789048744.424861:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789048744.424867:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111453056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048744.424910:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111453056:12345-0@lo:400:kworker.0 Request processed in 42us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048744.424916:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789048744.425021:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959c3fb9d500 x1875953111453056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048744.425035:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111453056:0@lo:400:kworker.0 00000100:00100000:0.0:1789048744.425180:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111452800:0@lo:400:kworker.0 00000100:00100000:0.0:1789048744.425208:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048744.425226:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789048744.425231:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111452544:0@lo:400:kworker.0 00000100:00100000:0.0:1789048744.425252:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048744.425276:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111452800 00000100:00100000:0.0:1789048744.425279:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111452800 00000100:00100000:0.0:1789048744.425300:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789048744.425306:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111452800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048744.425353:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111452800:12345-0@lo:400:kworker.0 Request processed in 47us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048744.425359:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789048744.425377:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111452544 00000100:00100000:0.0:1789048744.425380:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111452544 00000100:00100000:0.0:1789048744.425403:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789048744.425410:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32918450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:3623:x1875953111452544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048744.425436:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32918450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:3623:x1875953111452544:12345-0@lo:400:kworker.0 Request processed in 27us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048744.425449:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789048744.425479:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111452544:0@lo:400:kworker.0 00010000:00080000:0.0:1789048744.425489:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959c3fb9dc00 x1875953111452800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048744.425498:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111452800:0@lo:400:kworker.0 00000100:00080000:1.0:1789048744.440489:0:17128:0:(import.c:65:import_set_state_nolock()) ffff959b08338800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789048744.440591:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1875953111452672:12345-0@lo:38:kworker.0 Request processed in 15920us (16127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048744.440602:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789048744.440629:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789048744.440639:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111452928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048744.440684:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111452928:12345-0@lo:400:kworker.0 Request processed in 47us (16139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048744.440691:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789048744.440734:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111452928:0@lo:400:kworker.0 00000100:00080000:2.0:1789048744.441098:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789048744.441118:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2408010450010a0 00000100:00080000:2.0:1789048744.441125:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789048744.441128:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c03136800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789048744.441148:0:3619:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000d32e8a0d): req@ffff959c08a8d500 x1875953111445248/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048744.441162:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111452672:0@lo:38:kworker.0 00000100:00100000:1.0:1789048744.441370:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048744.441395:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789048744.442397:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789048744.442414:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111453184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048744.442457:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048744.442674:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111445248 00000100:00100000:3.0:1789048744.442682:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111445248 00000100:00100000:3.0:1789048744.442718:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111453184 00000100:00100000:3.0:1789048744.442722:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111453184 00000100:00100000:3.0:1789048744.442736:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789048744.442743:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17164:x1875953111445248:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789048744.443174:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17164:x1875953111445248:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 430us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048744.443183:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789048744.443204:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789048744.443210:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111453184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789048744.443236:0:17128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789048744.443370:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17164:1875953111445248:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1789048744.443422:0:17164:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789048744.443461:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17164:1875953111453312:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789048744.443494:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048744.443525:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3c48c480 going to sleep for 11 seconds 00000100:00100000:1.0:1789048744.443539:0:17127:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789048744.443545:0:17127:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1789048744.443684:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111453312 00000100:00100000:1.0:1789048744.443689:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111453312 00000100:00100000:1.0:1789048744.443792:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789048744.443809:0:18100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17164:x1875953111453312:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789048744.443939:0:18100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17164:x1875953111453312:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 140us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048744.443946:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789048744.443971:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17164:1875953111453312:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789048744.444034:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17164:1875953111453440:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789048744.444059:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048744.444074:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3c48c480 going to sleep for 11 seconds 00000100:00100000:1.0:1789048744.444086:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111453440 00000100:00100000:1.0:1789048744.444090:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111453440 00000100:00100000:1.0:1789048744.444106:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789048744.444112:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17164:x1875953111453440:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789048744.444155:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17164:x1875953111453440:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 43us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048744.444161:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789048744.444185:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17164:1875953111453440:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1789048744.444217:0:17164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789048744.446070:0:17164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789048744.446147:0:17164:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 22, retries 0 00000004:00080000:1.0:1789048744.446151:0:17164:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:3.0:1789048744.446356:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111453184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3141us (3894us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048744.446366:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789048744.459683:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111453184:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789048744.550117:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789048744.805899:0:18125:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1789048744.926147:0:17157:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789048745.568288:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789048745.902106:0:18178:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789048745.902979:0:18178:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789048746.589698:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789048747.306034:0:18228:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789048747.306575:0:18228:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789048747.488043:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048732/real 1789048732] req@ffff959b08845880 x1875953111446272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048747 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048747.488091:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959b08845880 x1875953111446272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048747 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048747.488102:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048732/real 1789048732] req@ffff959b08847480 x1875953111446400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048747 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048747.488115:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959b08847480 x1875953111446400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048747 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789048747.488142:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789048747.488173:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789048747.488178:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111446272:0@lo:8:kworker.0 00000100:00080000:0.0:1789048747.488193:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789048747.488200:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00080000:1.0:1789048747.488567:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048747.488572:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789048747.488576:0:36:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789048747.488582:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:1.0:1789048747.488589:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789048747.488603:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff959c2ac8c000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048747.488628:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fb9f480 x1875953111453824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789048747.488639:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048747.488642:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789048747.488644:0:36:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789048747.488647:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:1.0:1789048747.488650:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789048747.488655:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff959c2ac8e800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048747.488665:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fb9e300 x1875953111453952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789048747.488687:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048747.488692:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789048747.488695:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048747.488699:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789048747.488774:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111453568:0@lo:400:kworker.0 00000100:00100000:1.0:1789048747.488873:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048747.488922:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111454336:0@lo:400:kworker.0 00000100:00100000:1.0:1789048747.488950:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048747.488975:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789048747.488980:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111454208:0@lo:400:kworker.0 00000100:00100000:1.0:1789048747.489009:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048747.489370:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111453696:0@lo:400:kworker.0 00000100:00100000:1.0:1789048747.489401:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048747.489421:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789048747.489425:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111454080:0@lo:400:kworker.0 00000100:00100000:1.0:1789048747.489443:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048747.489479:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111453568 00000100:00100000:1.0:1789048747.489487:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111453568 00000100:00100000:1.0:1789048747.489540:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789048747.489550:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3291a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:3623:x1875953111453568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048747.489604:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3291a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:3623:x1875953111453568:12345-0@lo:400:kworker.0 Request processed in 55us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048747.489611:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789048747.489647:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111454336 00000100:00100000:1.0:1789048747.489650:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111454336 00000100:00100000:1.0:1789048747.489674:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111454080 00000100:00100000:1.0:1789048747.489677:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111454080 00000100:00100000:1.0:1789048747.489689:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789048747.489696:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111454336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048747.489741:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111454336:12345-0@lo:400:kworker.0 Request processed in 45us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048747.489757:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789048747.489769:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789048747.489775:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111454080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048747.489807:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111454080:12345-0@lo:400:kworker.0 Request processed in 32us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048747.489813:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789048747.489832:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111454208 00000100:00100000:1.0:1789048747.489836:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111454208 00000100:00100000:1.0:1789048747.489867:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111453696 00000100:00100000:1.0:1789048747.489871:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111453696 00000100:00100000:1.0:1789048747.489885:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789048747.489892:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111454208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048747.489925:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111454208:12345-0@lo:400:kworker.0 Request processed in 33us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048747.489930:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789048747.489942:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789048747.489948:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1875953111453696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048747.489975:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1875953111453696:12345-0@lo:400:kworker.0 Request processed in 28us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048747.489981:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789048747.490026:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959c3fb9d880 x1875953111454080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048747.490499:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111446400:0@lo:8:kworker.0 00000100:00100000:0.0:1789048747.490534:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111453824:0@lo:8:kworker.0 00000400:00000100:0.0:1789048747.490578:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875953111453824 offset 0 length 520: 4 00000100:00100000:0.0:1789048747.490595:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111453952:0@lo:8:kworker.0 00000400:00000100:0.0:1789048747.490613:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875953111453952 offset 0 length 520: 4 00000100:00100000:1.0:1789048747.494126:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111454080:0@lo:400:kworker.0 00000100:00100000:1.0:1789048747.494196:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111453696:0@lo:400:kworker.0 00000100:00100000:0.0:1789048747.494396:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111454208:0@lo:400:kworker.0 00000100:00100000:0.0:1789048747.494410:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111453568:0@lo:400:kworker.0 00010000:00080000:0.0:1789048747.494427:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959c3fb9ed80 x1875953111454336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048747.494439:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111454336:0@lo:400:kworker.0 00010000:00010000:2.0:1789048747.614868:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048748.515111:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048738/real 1789048738] req@ffff959b08844e00 x1875953111448832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048748 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048748.515173:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959b08844e00 x1875953111448832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048748 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048748.515211:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048738/real 1789048738] req@ffff959c08a8c380 x1875953111448704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048748 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048748.515224:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959c08a8c380 x1875953111448704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048748 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789048748.515248:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b0833b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789048748.515279:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789048748.515283:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111448832:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789048748.515289:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c414c0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789048748.515294:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789048748.515297:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111448704:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789048748.517217:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048748.517225:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789048748.517228:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048748.517231:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789048748.517265:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048748.517269:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789048748.517273:0:8:0:(import.c:65:import_set_state_nolock()) ffff959c414c0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789048748.517284:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 493 00000100:00080000:0.0:1789048748.517293:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789048748.517308:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff959c414c0800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048748.517355:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080d9500 x1875953111454976/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789048748.517373:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048748.517398:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789048748.517400:0:8:0:(import.c:65:import_set_state_nolock()) ffff959b0833b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789048748.517404:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 493 00000100:00080000:0.0:1789048748.517407:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789048748.517413:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff959b0833b800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048748.517427:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080daa00 x1875953111455104/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789048748.517474:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111454592:0@lo:400:kworker.0 00000100:00100000:0.0:1789048748.517560:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048748.517609:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789048748.517616:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111454464:0@lo:400:kworker.0 00000100:00100000:0.0:1789048748.517646:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048748.517677:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111455232:0@lo:400:kworker.0 00000100:00100000:0.0:1789048748.517703:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048748.517746:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111454720:0@lo:400:kworker.0 00000100:00100000:0.0:1789048748.517771:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048748.517791:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789048748.517796:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111454848:0@lo:400:kworker.0 00000100:00100000:0.0:1789048748.517819:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048748.518606:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111455232 00000100:00100000:1.0:1789048748.518619:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111455232 00000100:00100000:1.0:1789048748.518688:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111454720 00000100:00100000:1.0:1789048748.518693:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111454720 00000100:00100000:1.0:1789048748.518723:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789048748.518735:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111455232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048748.518819:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111455232:12345-0@lo:400:kworker.0 Request processed in 85us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048748.518826:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789048748.518911:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789048748.518919:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111454720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048748.518967:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111454720:12345-0@lo:400:kworker.0 Request processed in 49us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048748.518974:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789048748.518994:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111454464 00000100:00100000:1.0:1789048748.518997:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111454464 00000100:00100000:1.0:1789048748.519020:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789048748.519026:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3291a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:3621:x1875953111454464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048748.519055:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3291a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:3621:x1875953111454464:12345-0@lo:400:kworker.0 Request processed in 30us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048748.519062:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789048748.519100:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111454976:0@lo:8:kworker.0 00000400:00000100:1.0:1789048748.519129:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875953111454976 offset 0 length 520: 4 00000100:00100000:1.0:1789048748.519144:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111455104:0@lo:8:kworker.0 00000400:00000100:1.0:1789048748.519161:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875953111455104 offset 0 length 520: 4 00000100:00100000:0.0:1789048748.519241:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111454592 00000100:00100000:0.0:1789048748.519245:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111454592 00000100:00100000:0.0:1789048748.519280:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111454848 00000100:00100000:0.0:1789048748.519282:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111454848 00000100:00100000:0.0:1789048748.519295:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789048748.519300:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111454592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048748.519353:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111454592:12345-0@lo:400:kworker.0 Request processed in 52us (1792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048748.519365:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789048748.519378:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789048748.519383:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111454848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048748.519408:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111454848:12345-0@lo:400:kworker.0 Request processed in 25us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048748.519414:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789048748.519457:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111454464:0@lo:400:kworker.0 00010000:00080000:0.0:1789048748.519472:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959b080d8700 x1875953111455232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048748.519485:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111455232:0@lo:400:kworker.0 00000100:00100000:0.0:1789048748.519495:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111454592:0@lo:400:kworker.0 00000100:00100000:0.0:1789048748.519529:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111454848:0@lo:400:kworker.0 00010000:00080000:0.0:1789048748.519539:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959b080d8e00 x1875953111454720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048748.519548:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111454720:0@lo:400:kworker.0 00010000:00010000:2.0:1789048748.637642:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789048748.896834:0:18276:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0713a7e0 20000000:00000080:0.0:1789048748.896851:0:18276:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff959c2a5f3800 uarg=0000000000000000 20000000:01000000:0.0:1789048748.896900:0:18276:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789048748.896907:0:18276:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789048748.896912:0:18276:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789048748.912292:0:18277:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1789048748.915049:0:18276:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789048748.932703:0:18276:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789048748.942835:0:18276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff959c3ef3d000/0x133f221c08777109 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048748.942869:0:18276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959b08365a00/0x133f221c08776fb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08776fab expref: 17 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048748.942899:0:18276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959b08364400/0x133f221c087770b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087770ae expref: 17 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048748.942909:0:18276:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959c3ef3d000/0x133f221c08777109 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048748.942972:0:18276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959b08364400/0x133f221c087770b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c087770ae expref: 17 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048748.942995:0:18276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959b08364400/0x133f221c087770b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c087770ae expref: 17 pid: 17115 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048748.943016:0:18276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18276:1875953111455360:0@lo:104: 00000100:00100000:3.0:1789048748.943120:0:18276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789048748.943205:0:18276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959b08365a00/0x133f221c08776fb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08776fab expref: 17 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048748.943213:0:18276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959b08365a00/0x133f221c08776fb2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08776fab expref: 17 pid: 17115 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048748.943221:0:18276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18276:1875953111455488:0@lo:104: 00000100:00100000:3.0:1789048748.943242:0:18276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048748.943266:0:18276:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2aca5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048748.943314:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111455360 00000100:00100000:1.0:1789048748.943331:0:17106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111455360 00000100:00100000:1.0:1789048748.943399:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111455488 00000100:00100000:1.0:1789048748.943402:0:17106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111455488 00000100:00100000:1.0:1789048748.943421:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789048748.943430:0:17106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+4:18276:x1875953111455360:12345-0@lo:104: 00010000:00010000:1.0:1789048748.943464:0:17106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d200/0x133f221c087770ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087770b5 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048748.943573:0:17106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789048748.943580:0:17106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+4:18276:x1875953111455360:12345-0@lo:104: Request processed in 152us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048748.943602:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789048748.943621:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789048748.943627:0:17106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+3:18276:x1875953111455488:12345-0@lo:104: 00010000:00010000:1.0:1789048748.943635:0:17106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959b07ba1400/0x133f221c08776fab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08776fb2 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048748.943667:0:17106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789048748.943672:0:17106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+3:18276:x1875953111455488:12345-0@lo:104: Request processed in 45us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048748.943677:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789048748.944033:0:18276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18276:1875953111455360:0@lo:104: 00000100:00100000:3.0:1789048748.944044:0:18276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18276:1875953111455488:0@lo:104: 00010000:00010000:3.0:1789048748.944067:0:18276:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff959c3ef3d000/0x133f221c08777109 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048748.945148:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789048748.945165:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d200/0x133f221c087770ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087770b5 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048748.945213:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d200 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048748.945218:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d200/0x133f221c087770ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c087770b5 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048748.945229:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d200/0x133f221c087770ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c087770b5 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048748.945236:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d200/0x133f221c087770ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c087770b5 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048748.945242:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789048748.945311:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d200/0x133f221c087770ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087770b5 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048748.945319:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048748.945403:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d200/0x133f221c087770ae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087770b5 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048748.945412:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d200/0x133f221c087770ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087770b5 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048748.945434:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111455616:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048748.945435:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048748.945444:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959b07ba1400/0x133f221c08776fab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08776fb2 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048748.945455:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1400 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048748.945458:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959b07ba1400/0x133f221c08776fab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08776fb2 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048748.945478:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959b07ba1400/0x133f221c08776fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08776fb2 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048748.945485:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959b07ba1400/0x133f221c08776fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08776fb2 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048748.945491:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789048748.945511:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789048748.945513:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959b07ba1400/0x133f221c08776fab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08776fb2 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048748.945521:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048748.945546:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959b07ba1400/0x133f221c08776fab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08776fb2 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048748.945555:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959b07ba1400/0x133f221c08776fab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08776fb2 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048748.945587:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048748.945589:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048748.945591:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048748.945601:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048748.945640:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111455616 00000100:00100000:2.0:1789048748.945649:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111455616 00010000:00010000:2.0:1789048748.945685:0:17108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959b08364400/0x133f221c087770b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087770ae expref: 18 pid: 17115 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048748.945743:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789048748.945755:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:3621:x1875953111455616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048748.945771:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048748.945785:0:17108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959b08364400/0x133f221c087770b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087770ae expref: 18 pid: 17115 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048748.945799:0:17108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959b08364400/0x133f221c087770b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c087770ae expref: 18 pid: 17115 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048748.945814:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b08364400/0x133f221c087770b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c087770ae expref: 18 pid: 17115 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048748.945830:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048748.945917:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:3621:x1875953111455616:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048748.945928:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789048748.945968:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111455616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048748.945978:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3622:1875953111455744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048748.946029:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048748.946085:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111455744 00000100:00100000:0.0:1789048748.946094:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111455744 00010000:00010000:0.0:1789048748.946126:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959b08365a00/0x133f221c08776fb2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08776fab expref: 17 pid: 17115 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048748.946166:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789048748.946174:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:3622:x1875953111455744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789048748.946187:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048748.946193:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959b08365a00/0x133f221c08776fb2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08776fab expref: 17 pid: 17115 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048748.946205:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959b08365a00/0x133f221c08776fb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08776fab expref: 17 pid: 17115 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048748.946220:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b08365a00/0x133f221c08776fb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08776fab expref: 17 pid: 17115 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048748.946235:0:17107:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959c3ef3d000/0x133f221c08777109 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048748.946244:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3d000/0x133f221c08777109 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048748.946259:0:17107:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef3d000/0x133f221c08777109 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048748.946267:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef3d000/0x133f221c08777109 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048748.946273:0:17107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff959c3ef3d000/0x133f221c08777109 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048748.946291:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff959c3ef3d000/0x133f221c08777109 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048748.946297:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d000 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048748.946302:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff959c3ef3d000/0x133f221c08777109 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048748.946310:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff959c3ef3d000/0x133f221c08777109 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048748.946322:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff959c3ef3d000/0x133f221c08777109 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048748.946366:0:18276:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff959c3ef3d000/0x133f221c08777109 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048748.946371:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789048748.946375:0:18276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff959c3ef3d000/0x133f221c08777109 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048748.946380:0:18276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3d000/0x133f221c08777109 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048748.946421:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+16:3622:x1875953111455744:12345-0@lo:103:ldlm_bl.0 Request processed in 249us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048748.946428:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789048748.947656:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3622:1875953111455744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789048749.021508:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789048749.021535:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111455872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048749.021613:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048749.021669:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111455872 00000100:00100000:1.0:1789048749.021676:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111455872 00000100:00100000:1.0:1789048749.021737:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789048749.021747:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111455872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789048749.021795:0:17127:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789048749.021841:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111455872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048749.021847:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789048749.021898:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111455872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048749.536424:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789048749.536457:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111456000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789048749.536527:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048749.536672:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111456000 00000100:00100000:3.0:1789048749.536682:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111456000 00000100:00100000:3.0:1789048749.536761:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789048749.536774:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111456000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789048749.536815:0:17128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789048749.536866:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111456000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048749.536874:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789048749.536940:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111456000:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789048749.661746:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789048750.049907:0:17856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789048750.685754:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789048750.943313:0:17119:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789048750.943323:0:17119:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c08aff800 from 13 10000000:01000000:1.0:1789048750.943330:0:17119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789048750.943449:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba1000/0x133f221c08777110 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048750.943466:0:17119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b07ba1000/0x133f221c08777110 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048750.943481:0:17119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b07ba1000/0x133f221c08777110 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048750.943517:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111456128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789048750.943862:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048750.943923:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11507000 going to sleep for 11 seconds 00000100:00100000:2.0:1789048750.944002:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111456128 00000100:00100000:2.0:1789048750.944013:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111456128 00000100:00100000:2.0:1789048750.944088:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789048750.944100:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32918050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+16:17119:x1875953111456128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048750.944123:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048750.944142:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c04cb1000/0x133f221c08777117 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777110 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048750.944182:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c04cb1000/0x133f221c08777117 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777110 expref: 17 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048750.944204:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c04cb1000/0x133f221c08777117 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777110 expref: 17 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048750.944215:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb1000, rc 0) 00000100:00100000:2.0:1789048750.944273:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32918050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:17119:x1875953111456128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048750.944282:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789048750.944503:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111456128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048750.944522:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b07ba1000/0x133f221c08777110 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777117 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048750.944644:0:17119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b07ba1000/0x133f221c08777110 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777117 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048750.944803:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111456256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048750.944848:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048750.944879:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0793a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789048750.944895:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111456256 00000100:00100000:3.0:1789048750.944899:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111456256 00000100:00100000:3.0:1789048750.944927:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789048750.944934:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32919450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:17119:x1875953111456256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048750.945070:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32919450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:17119:x1875953111456256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048750.945078:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789048750.945114:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111456256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048750.945142:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111456384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789048750.948599:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048750.948676:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0793a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789048750.949503:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111456384 00000100:00100000:1.0:1789048750.949517:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111456384 00000100:00100000:1.0:1789048750.949600:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789048750.949613:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3291b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:17119:x1875953111456384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048750.949818:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3291b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:17119:x1875953111456384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048750.949827:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789048750.950031:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111456384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789048750.952495:0:18344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789048750.952940:0:17119:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789048750.952977:0:17119:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789048750.952992:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba1000/0x133f221c08777110 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777117 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048750.953008:0:17119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b07ba1000/0x133f221c08777110 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777117 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048750.953019:0:17119:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789048750.953023:0:17119:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c04ca4000 from 13 10000000:01000000:2.0:1789048750.953026:0:17119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789048750.953075:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c04cb0c00/0x133f221c0877711e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048750.953086:0:17119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c04cb0c00/0x133f221c0877711e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048750.953099:0:17119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c04cb0c00/0x133f221c0877711e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048750.953148:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111456512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789048750.953263:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048750.953317:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2b027540 going to sleep for 11 seconds 00000100:00100000:1.0:1789048750.953759:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111456512 00000100:00100000:1.0:1789048750.953769:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111456512 00000100:00100000:1.0:1789048750.953828:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789048750.953840:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32919c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+17:17119:x1875953111456512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048750.953858:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048750.953877:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba1800/0x133f221c08777125 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c0877711e expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048750.953908:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba1800/0x133f221c08777125 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c0877711e expref: 18 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048750.953935:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba1800/0x133f221c08777125 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c0877711e expref: 18 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048750.953946:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1800, rc 0) 00000100:00100000:1.0:1789048750.954001:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32919c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:17119:x1875953111456512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048750.954010:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789048750.954704:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111456512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048750.954728:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c04cb0c00/0x133f221c0877711e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777125 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048750.954800:0:17119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c04cb0c00/0x133f221c0877711e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777125 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048750.954892:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111456640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048750.954938:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048750.954980:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2b027540 going to sleep for 11 seconds 00000100:00100000:1.0:1789048750.955046:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111456640 00000100:00100000:1.0:1789048750.955052:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111456640 00000100:00100000:1.0:1789048750.955092:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789048750.955101:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:17119:x1875953111456640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048750.955257:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:17119:x1875953111456640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048750.955264:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789048750.955301:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111456640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048750.955329:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06971c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111456768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048750.955403:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048750.955417:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c115070c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048750.955865:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111456768 00000100:00100000:2.0:1789048750.955870:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111456768 00000100:00100000:2.0:1789048750.955910:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789048750.955918:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:17119:x1875953111456768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048750.956027:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:17119:x1875953111456768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048750.956035:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789048750.956169:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06971c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111456768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789048750.957964:0:18345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789048750.958436:0:17119:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789048750.958465:0:17119:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789048750.958477:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c04cb0c00/0x133f221c0877711e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777125 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048750.958490:0:17119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c04cb0c00/0x133f221c0877711e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777125 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789048751.270983:0:17877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789048751.709738:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048752.733904:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048753.630089:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111456896:0@lo:400:kworker.0 00000100:00100000:3.0:1789048753.630198:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048753.630300:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111456896 00000100:00100000:0.0:1789048753.630312:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111456896 00000100:00100000:0.0:1789048753.630415:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789048753.630443:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:3621:x1875953111456896:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789048753.630630:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048753.630636:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789048753.630639:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048753.630642:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789048753.633988:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:3621:x1875953111456896:12345-0@lo:400:kworker.0 Request processed in 3531us (3774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048753.634010:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1789048753.637745:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048753.637784:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789048753.637788:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048753.637791:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789048753.638053:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06970a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111457024:0@lo:400:kworker.0 00000100:00100000:0.0:1789048753.638160:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048753.638223:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789048753.638232:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111457152:0@lo:400:kworker.0 00000100:00100000:0.0:1789048753.638260:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048753.638298:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111457280:0@lo:400:kworker.0 00000100:00100000:0.0:1789048753.638323:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048753.638374:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789048753.638380:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111457408:0@lo:400:kworker.0 00000100:00100000:0.0:1789048753.638403:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048753.638438:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111457152 00000100:00100000:0.0:1789048753.638448:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111457152 00000100:00100000:0.0:1789048753.638506:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111457408 00000100:00100000:0.0:1789048753.638509:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111457408 00000100:00100000:0.0:1789048753.638527:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789048753.638536:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111457152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048753.638599:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111457152:12345-0@lo:400:kworker.0 Request processed in 63us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048753.638606:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789048753.638626:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789048753.638632:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111457408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048753.638675:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111457408:12345-0@lo:400:kworker.0 Request processed in 32us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048753.638700:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789048753.638746:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959b06970000 x1875953111457408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048753.638762:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111457408:0@lo:400:kworker.0 00010000:00080000:0.0:1789048753.638794:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959b06971f80 x1875953111457152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048753.638803:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111457152:0@lo:400:kworker.0 00000100:00100000:1.0:1789048753.639219:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111457024 00000100:00100000:1.0:1789048753.639225:0:18100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111457024 00000100:00100000:1.0:1789048753.639257:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111457280 00000100:00100000:1.0:1789048753.639260:0:18100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111457280 00000100:00100000:1.0:1789048753.639275:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789048753.639283:0:18100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111457024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048753.639359:0:18100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111457024:12345-0@lo:400:kworker.0 Request processed in 76us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048753.639365:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789048753.639380:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789048753.639386:0:18100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111457280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048753.639420:0:18100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111457280:12345-0@lo:400:kworker.0 Request processed in 35us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048753.639425:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789048753.639472:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111457280:0@lo:400:kworker.0 00000100:00100000:1.0:1789048753.639496:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06970a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111457024:0@lo:400:kworker.0 00000100:00100000:3.0:1789048753.641358:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111456896:0@lo:400:kworker.0 00010000:00010000:2.0:1789048753.758673:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048754.143629:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06970a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111457536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048754.143747:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048754.143832:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111457536 00000100:00100000:1.0:1789048754.143842:0:18100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111457536 00000100:00100000:1.0:1789048754.143907:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789048754.143919:0:18100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111457536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789048754.143995:0:18100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789048754.144072:0:18100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111457536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 155us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048754.144080:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789048754.144142:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06970a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111457536:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789048754.149130:0:17157:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789048754.653805:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111457664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048754.653909:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048754.654009:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111457664 00000100:00100000:2.0:1789048754.654019:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111457664 00000100:00100000:2.0:1789048754.654096:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789048754.654104:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111457664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789048754.654152:0:17128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789048754.655686:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111457664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1573us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048754.655700:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789048754.655942:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111457664:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789048754.793436:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048755.806630:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048756.831800:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789048757.652771:0:18625:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789048757.652775:0:18625:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789048757.652777:0:18625:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789048757.652887:0:18625:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff959b081c1800 00000020:01000004:3.0:1789048757.652903:0:18625:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789048757.652916:0:18625:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789048757.652940:0:18625:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff959c2a423380) 00000020:00000080:3.0:1789048757.652960:0:18625:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789048757.734033:0:18625:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789048757.737590:0:18625:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789048757.738089:0:18625:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789048757.738262:0:18625:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789048757.738614:0:18625:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789048757.738860:0:18625:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789048757.739538:0:18625:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1789048757.741543:0:18625:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789048757.741774:0:18625:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789048757.741788:0:18625:0:(osd_handler.c:8921:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789048757.741801:0:18625:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x133f221c08777133 00000020:01000004:2.0:1789048757.741809:0:18625:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789048757.741832:0:18625:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789048757.741836:0:18625:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789048757.741842:0:18625:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789048757.741848:0:18625:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789048757.741859:0:18625:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff959c394b99c0) 00000020:00000080:2.0:1789048757.741871:0:18625:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1789048757.742986:0:18625:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789048757.743144:0:18625:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789048757.743150:0:18625:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789048757.745893:0:18625:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789048757.745905:0:18625:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789048757.746406:0:18625:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789048757.746413:0:18625:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789048757.747711:0:18625:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789048757.747900:0:18625:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789048757.747906:0:18625:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789048757.753395:0:18625:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789048757.753415:0:18625:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789048757.772450:0:18625:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789048757.772799:0:18625:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789048757.772807:0:18625:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789048757.774211:0:18625:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789048757.774221:0:18625:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789048757.776555:0:18625:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789048757.776568:0:18625:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789048757.778874:0:18625:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789048757.779147:0:18625:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789048757.779154:0:18625:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789048757.779880:0:18625:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789048757.779888:0:18625:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789048757.825195:0:18625:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789048757.825882:0:18625:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789048757.825889:0:18625:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789048757.830054:0:18625:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789048757.830075:0:18625:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789048757.831106:0:18625:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789048757.831140:0:18625:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789048757.831147:0:18625:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789048757.846519:0:18625:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789048757.846566:0:18625:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.116@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789048757.846570:0:18625:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789048757.846572:0:18625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789048757.846573:0:18625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048757.846574:0:18625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048757.846575:0:18625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048757.846576:0:18625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048757.846578:0:18625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789048757.846580:0:18625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048757.846581:0:18625:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789048757.846584:0:18625:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789048757.846587:0:18625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789048757.846593:0:18625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789048757.846594:0:18625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048757.846595:0:18625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048757.846596:0:18625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048757.846597:0:18625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048757.846598:0:18625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789048757.846599:0:18625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048757.846599:0:18625:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789048757.846747:0:18625:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789048757.846768:0:18625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111457792:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789048757.846838:0:18625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048757.846931:0:18625:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41497840 going to sleep for 11 seconds 00000100:00100000:1.0:1789048757.848391:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111457792 00000100:00100000:1.0:1789048757.848416:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111457792 00000100:00100000:1.0:1789048757.848528:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789048757.848539:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:18625:x1875953111457792:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789048757.848572:0:17116:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789048757.848576:0:17116:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789048757.848579:0:17116:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789048757.849145:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:18625:x1875953111457792:12345-0@lo:253:mount.lustre.0 Request processed in 607us (2305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048757.849153:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789048757.849244:0:18625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111457792:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789048757.849259:0:18625:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789048757.849262:0:18625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789048757.849263:0:18625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789048757.849265:0:18625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048757.849266:0:18625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048757.849267:0:18625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048757.849268:0:18625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048757.849270:0:18625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789048757.849271:0:18625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048757.849272:0:18625:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789048757.849293:0:18625:0:(tgt_mount.c:101:server_register_mount()) register mount ffff959b081c1800 from lustre-OST0000 10000000:01000000:0.0:1789048757.849319:0:18625:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789048757.849322:0:18625:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789048757.849329:0:18625:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff959c20228000 local copy 00010000:00010000:0.0:1789048757.849375:0:18625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365600/0x133f221c08776eee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776ef5 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048757.849488:0:18625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111457920:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048757.849523:0:18625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048757.850501:0:18625:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2050f600 going to sleep for 11 seconds 00000100:00100000:2.0:1789048757.850589:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111457920 00000100:00100000:2.0:1789048757.850597:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111457920 00000100:00100000:2.0:1789048757.850661:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789048757.850669:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:18625:x1875953111457920:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048757.850776:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:18625:x1875953111457920:12345-0@lo:501:mount.lustre.0 Request processed in 108us (1252us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789048757.850784:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789048757.850914:0:18625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111457920:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789048757.850945:0:18625:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789048757.850979:0:18625:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789048757.850988:0:18625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365600/0x133f221c08776eee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776ef5 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048757.850999:0:18625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b08365600/0x133f221c08776eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776ef5 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048757.851027:0:18625:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff959b081c1800 10000000:01000000:0.0:1789048757.851032:0:18625:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789048757.851038:0:18625:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789048757.851041:0:18625:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789048757.851045:0:18625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789048757.851048:0:18625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789048757.851075:0:18625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365e00/0x133f221c08777141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048757.851082:0:18625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b08365e00/0x133f221c08777141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048757.851090:0:18625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b08365e00/0x133f221c08777141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048757.851106:0:18625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111458048:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789048757.851135:0:18625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048757.851156:0:18625:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2050f600 going to sleep for 11 seconds 00000100:00100000:2.0:1789048757.851584:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111458048 00000100:00100000:2.0:1789048757.851590:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111458048 00000100:00100000:2.0:1789048757.851617:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789048757.851634:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+18:18625:x1875953111458048:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789048757.851644:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048757.851657:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c04cb0000/0x133f221c08777148 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777141 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048757.851691:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c04cb0000/0x133f221c08777148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777141 expref: 19 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048757.851701:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c04cb0000/0x133f221c08777148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777141 expref: 19 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048757.851709:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c04cb0000, rc 0) 00000100:00100000:2.0:1789048757.851752:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+19:18625:x1875953111458048:12345-0@lo:101:mount.lustre.0 Request processed in 128us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048757.851758:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789048757.851899:0:18625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111458048:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789048757.851916:0:18625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b08365e00/0x133f221c08777141 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777148 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048757.851936:0:18625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b08365e00/0x133f221c08777141 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777148 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789048757.853367:0:18625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789048757.853976:0:18625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:2.0:1789048757.856617:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789048757.857715:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789048757.857773:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789048757.857802:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789048757.857818:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789048757.857832:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789048757.857847:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789048757.857877:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789048757.857884:0:18625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789048757.858005:0:18625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111458176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048757.858074:0:18625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048757.858155:0:18625:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c19e4d600 going to sleep for 11 seconds 00000100:00100000:0.0:1789048757.858535:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111458176 00000100:00100000:0.0:1789048757.858543:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111458176 00000100:00100000:0.0:1789048757.858641:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789048757.858651:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+19:18625:x1875953111458176:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048757.858822:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+19:18625:x1875953111458176:12345-0@lo:501:mount.lustre.0 Request processed in 172us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048757.858830:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789048757.859175:0:18625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111458176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048757.859213:0:18625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111458304:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789048757.859497:0:18625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048757.859529:0:18625:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c19e4d600 going to sleep for 11 seconds 00000100:00100000:1.0:1789048757.859589:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111458304 00000100:00100000:1.0:1789048757.859594:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111458304 00000100:00100000:1.0:1789048757.859641:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789048757.859649:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+19:18625:x1875953111458304:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789048757.860926:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+19:18625:x1875953111458304:12345-0@lo:503:mount.lustre.0 Request processed in 1271us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048757.860938:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789048757.861745:0:18625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111458304:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789048757.863600:0:18625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789048757.863891:0:18625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111458432:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048757.864040:0:18625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048757.864173:0:18625:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88840 going to sleep for 11 seconds 00000100:00100000:2.0:1789048757.864656:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111458432 00000100:00100000:2.0:1789048757.864664:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111458432 00000100:00100000:2.0:1789048757.864809:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789048757.864819:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+19:18625:x1875953111458432:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048757.865759:0:18625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111458432:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789048757.866005:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789048757.866047:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789048757.866061:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789048757.866072:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789048757.866084:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789048757.866096:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789048757.866107:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789048757.866118:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789048757.866129:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789048757.866141:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789048757.866151:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789048757.866162:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789048757.866192:0:18625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111458560:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048757.866778:0:18625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048757.866849:0:18625:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88840 going to sleep for 11 seconds 00000100:00100000:2.0:1789048757.866905:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+19:18625:x1875953111458432:12345-0@lo:502:mount.lustre.0 Request processed in 2086us (2864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048757.866916:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789048757.867018:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111458560 00000100:00100000:2.0:1789048757.867024:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111458560 00000100:00100000:1.0:1789048757.867076:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789048757.867086:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+19:18625:x1875953111458560:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789048757.867194:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+19:18625:x1875953111458560:12345-0@lo:502:mount.lustre.0 Request processed in 110us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048757.867201:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789048757.867328:0:18625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111458560:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789048757.867414:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789048757.867424:0:18625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1789048757.868210:0:18642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789048757.868219:0:18642:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1789048757.869904:0:18642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048757.869911:0:18642:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789048757.869926:0:18642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789048757.869943:0:18642:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff959c2022b380) 00000020:00000080:1.0:1789048757.870042:0:18642:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789048757.870061:0:18642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789048757.870141:0:18642:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959b081c1800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789048757.870148:0:18642:0:(osd_handler.c:8921:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789048757.870154:0:18642:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x133f221c08777156 00010000:00010000:1.0:1789048757.878742:0:18642:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1789048757.879521:0:18642:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1789048757.883756:0:18642:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1789048757.885653:0:18642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789048757.885668:0:18642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048757.885684:0:18642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048757.885686:0:18642:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789048757.885690:0:18642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789048757.885693:0:18642:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1789048757.885695:0:18642:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789048757.885696:0:18642:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789048757.885698:0:18642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789048757.885701:0:18642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048757.885702:0:18642:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789048757.885704:0:18642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048757.885706:0:18642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048757.885708:0:18642:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789048757.885712:0:18642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789048757.885713:0:18642:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789048757.885716:0:18642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048757.885718:0:18642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048757.885719:0:18642:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789048757.885721:0:18642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048757.885723:0:18642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048757.885724:0:18642:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789048757.885727:0:18642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789048757.885760:0:18642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048757.885764:0:18642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048757.885765:0:18642:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789048757.885768:0:18642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1789048757.885932:0:18625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789048757.885976:0:18625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789048757.885991:0:18625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365e00/0x133f221c08777141 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777148 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048757.886002:0:18625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b08365e00/0x133f221c08777141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777148 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048757.886017:0:18625:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959b081c1800 from 1 10000000:01000000:2.0:1789048757.886019:0:18625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789048757.886053:0:18625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c04cb0800/0x133f221c0877715d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048757.886060:0:18625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c04cb0800/0x133f221c0877715d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048757.886071:0:18625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c04cb0800/0x133f221c0877715d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048757.886096:0:18625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111458688:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789048757.886168:0:18625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048757.886209:0:18625:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c115070c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048757.886504:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111458688 00000100:00100000:1.0:1789048757.886512:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111458688 00000100:00100000:1.0:1789048757.886567:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789048757.886578:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+19:18625:x1875953111458688:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789048757.886591:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048757.886605:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba0800/0x133f221c08777164 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c0877715d expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048757.886636:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba0800/0x133f221c08777164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c0877715d expref: 20 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048757.886647:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba0800/0x133f221c08777164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c0877715d expref: 20 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048757.886655:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0800, rc 0) 00000100:00100000:1.0:1789048757.886802:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+20:18625:x1875953111458688:12345-0@lo:101:mount.lustre.0 Request processed in 225us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048757.886809:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789048757.886937:0:18625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111458688:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789048757.886964:0:18625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c04cb0800/0x133f221c0877715d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777164 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048757.886973:0:18625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c04cb0800/0x133f221c0877715d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777164 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789048757.890368:0:18625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789048757.890828:0:18625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789048757.891073:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789048757.891099:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789048757.891118:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789048757.891124:0:18625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789048757.891205:0:18625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111458816:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048757.891542:0:18625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048757.891645:0:18625:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11507840 going to sleep for 11 seconds 00000100:00100000:0.0:1789048757.895617:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111458816 00000100:00100000:0.0:1789048757.895643:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111458816 00000100:00100000:0.0:1789048757.895736:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789048757.895747:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+20:18625:x1875953111458816:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048757.895916:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+20:18625:x1875953111458816:12345-0@lo:501:mount.lustre.0 Request processed in 171us (4373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048757.895924:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789048757.896726:0:18625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111458816:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048757.896781:0:18625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111458944:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789048757.896834:0:18625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048757.896876:0:18625:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11507840 going to sleep for 11 seconds 00000100:00100000:3.0:1789048757.897099:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111458944 00000100:00100000:3.0:1789048757.897106:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111458944 00000100:00100000:3.0:1789048757.897155:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789048757.897171:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+20:18625:x1875953111458944:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789048757.897285:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+20:18625:x1875953111458944:12345-0@lo:503:mount.lustre.0 Request processed in 115us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048757.897292:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789048757.898828:0:18625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111458944:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789048757.899270:0:18625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789048757.899376:0:18625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111459072:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789048757.899440:0:18625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048757.899483:0:18625:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c115070c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048757.899641:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111459072 00000100:00100000:3.0:1789048757.899649:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111459072 00000100:00100000:3.0:1789048757.899768:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789048757.899778:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+20:18625:x1875953111459072:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048757.899883:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+20:18625:x1875953111459072:12345-0@lo:502:mount.lustre.0 Request processed in 105us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048757.899891:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789048757.902360:0:18625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111459072:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789048757.902609:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789048757.902657:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789048757.902751:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789048757.902774:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789048757.902788:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789048757.902804:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789048757.902835:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789048757.902851:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1789048757.902864:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789048757.902877:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1789048757.902889:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1789048757.902928:0:18625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111459200:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789048757.903451:0:18625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048757.904702:0:18625:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c115070c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048757.907394:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111459200 00000100:00100000:3.0:1789048757.907409:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111459200 00000100:00100000:3.0:1789048757.907468:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789048757.907477:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+20:18625:x1875953111459200:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048757.907664:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+20:18625:x1875953111459200:12345-0@lo:502:mount.lustre.0 Request processed in 187us (4213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048757.907877:0:18625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111459200:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789048757.907994:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1789048757.908008:0:18625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000100:00100000:3.0:1789048757.908899:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000020:01000000:0.0:1789048757.909504:0:18646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048757.909514:0:18646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048757.909517:0:18646:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789048757.909524:0:18646:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959b081c1800 00000020:00000080:0.0:1789048757.909534:0:18646:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789048757.909543:0:18646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048757.909545:0:18646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048757.909546:0:18646:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789048757.909549:0:18646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048757.909551:0:18646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048757.909552:0:18646:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789048757.909555:0:18646:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959b081c1800 00000020:00000080:0.0:1789048757.909557:0:18646:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789048757.909619:0:18646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048757.909632:0:18646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048757.909634:0:18646:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789048757.909637:0:18646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048757.909640:0:18646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048757.909641:0:18646:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789048757.909644:0:18646:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959b081c1800 00000020:00000080:0.0:1789048757.909646:0:18646:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789048757.909665:0:18646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048757.909668:0:18646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048757.911075:0:18646:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789048757.911085:0:18646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048757.911091:0:18646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048757.911093:0:18646:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789048757.911098:0:18646:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959b081c1800 00000020:00000080:0.0:1789048757.911100:0:18646:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789048757.911147:0:18646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048757.911150:0:18646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048757.911151:0:18646:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789048757.911154:0:18646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1789048757.912080:0:18625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789048757.912117:0:18625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789048757.912132:0:18625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c04cb0800/0x133f221c0877715d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777164 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048757.912143:0:18625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c04cb0800/0x133f221c0877715d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777164 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048757.912195:0:18625:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789048757.912206:0:18625:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff959b081c1800 10000000:01000000:3.0:1789048757.912208:0:18625:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff959b081c1800 10000000:01000000:3.0:1789048757.912212:0:18625:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789048757.912218:0:18625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959b081c1800 from 1 10000000:01000000:3.0:1789048757.912221:0:18625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789048757.914515:0:18625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3dc00/0x133f221c0877716b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048757.914533:0:18625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef3dc00/0x133f221c0877716b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048757.914544:0:18625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef3dc00/0x133f221c0877716b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048757.914571:0:18625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111459328:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789048757.914651:0:18625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048757.915918:0:18625:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b880c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048757.927616:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111459328 00000100:00100000:0.0:1789048757.927643:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111459328 00000100:00100000:0.0:1789048757.927726:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789048757.927736:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+20:18625:x1875953111459328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789048757.927769:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048757.927788:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b08364400/0x133f221c08777172 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c0877716b expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048757.927816:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b08364400/0x133f221c08777172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c0877716b expref: 21 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048757.927826:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b08364400/0x133f221c08777172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c0877716b expref: 21 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048757.927834:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08364400, rc 0) 00000100:00100000:0.0:1789048757.942891:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:18625:x1875953111459328:12345-0@lo:101:mount.lustre.0 Request processed in 15147us (28232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048757.942903:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789048757.949987:0:18625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111459328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789048757.950023:0:18625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef3dc00/0x133f221c0877716b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777172 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048757.950036:0:18625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3dc00/0x133f221c0877716b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777172 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789048757.954765:0:18625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789048757.955076:0:18625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789048757.956119:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789048757.956165:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789048757.956181:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789048757.956196:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789048757.956220:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789048757.956409:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789048757.956447:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789048757.956464:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789048757.956479:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789048757.956493:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789048757.956512:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789048757.956524:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789048757.956536:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789048757.956549:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789048757.956563:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789048757.956575:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789048757.958512:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789048757.958532:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789048757.958545:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789048757.958558:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789048757.958570:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789048757.958584:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789048757.958615:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789048757.958643:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789048757.958660:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1789048757.958822:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1789048757.958842:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1789048757.958857:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1789048757.958870:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1789048757.958882:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1789048757.958898:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1789048757.958913:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1789048757.958928:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1789048757.958941:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1789048757.962494:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1789048757.962533:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1789048757.962548:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1789048757.962596:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1789048757.962602:0:18625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789048757.964473:0:18625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111459456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048757.964542:0:18625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048757.965516:0:18625:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c37fc00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048757.965545:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111459456 00000100:00100000:3.0:1789048757.965552:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111459456 00000100:00100000:3.0:1789048757.966832:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789048757.966859:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:18625:x1875953111459456:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048757.967040:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:18625:x1875953111459456:12345-0@lo:501:mount.lustre.0 Request processed in 185us (2496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048757.967048:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789048757.971157:0:18625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111459456:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048757.971220:0:18625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111459584:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789048757.971325:0:18625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048757.975264:0:18625:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eaa9780 going to sleep for 11 seconds 00000100:00100000:0.0:1789048757.975833:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111459584 00000100:00100000:0.0:1789048757.975844:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111459584 00000100:00100000:0.0:1789048757.975918:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789048757.975927:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:18625:x1875953111459584:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789048757.976103:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:18625:x1875953111459584:12345-0@lo:503:mount.lustre.0 Request processed in 177us (4778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048757.976111:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789048757.976505:0:18625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111459584:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789048757.977009:0:18625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789048757.977089:0:18625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111459712:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789048757.977147:0:18625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048757.977195:0:18625:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eaa9780 going to sleep for 11 seconds 00000100:00100000:0.0:1789048757.977463:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111459712 00000100:00100000:0.0:1789048757.977470:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111459712 00000100:00100000:0.0:1789048757.977500:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789048757.977507:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:18625:x1875953111459712:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048757.977610:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:18625:x1875953111459712:12345-0@lo:502:mount.lustre.0 Request processed in 103us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048757.977637:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789048757.980135:0:18625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111459712:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789048757.980400:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789048757.980449:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789048757.980464:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789048757.980474:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789048757.980485:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789048757.980496:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789048757.980507:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789048757.980519:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789048757.980531:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789048757.980543:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789048757.980556:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789048757.980569:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789048757.980581:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789048757.980592:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789048757.980603:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789048757.980617:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789048757.980647:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789048757.980686:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789048757.980713:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789048757.980728:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789048757.980742:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789048757.980753:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789048757.980765:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789048757.980780:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789048757.980794:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1789048757.980807:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1789048757.980819:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1789048757.980833:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1789048757.980847:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1789048757.980860:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1789048757.980872:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1789048757.980884:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1789048757.980897:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1789048757.980926:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1789048757.980942:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1789048757.981541:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1789048757.981566:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1789048757.981582:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1789048757.981596:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1789048757.981611:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1789048757.981637:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1789048757.981652:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1789048757.981666:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1789048757.981680:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1789048757.981695:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1789048757.981710:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1789048757.981723:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1789048757.981736:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1789048757.981806:0:18625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111459840:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789048757.981882:0:18625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048757.981924:0:18625:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eaa9780 going to sleep for 11 seconds 00000100:00100000:0.0:1789048757.982206:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111459840 00000100:00100000:0.0:1789048757.982214:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111459840 00000100:00100000:0.0:1789048757.982305:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789048757.982315:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:18625:x1875953111459840:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048757.982458:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:18625:x1875953111459840:12345-0@lo:502:mount.lustre.0 Request processed in 144us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048757.982466:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789048757.982561:0:18625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111459840:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789048757.982813:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1789048757.982838:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1789048757.982863:0:18625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111459968:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789048757.982901:0:18625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048757.982923:0:18625:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eaa9780 going to sleep for 11 seconds 00000100:00100000:3.0:1789048757.983059:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111459968 00000100:00100000:3.0:1789048757.983065:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111459968 00000100:00100000:3.0:1789048757.983092:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789048757.983099:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:18625:x1875953111459968:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048757.983185:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:18625:x1875953111459968:12345-0@lo:502:mount.lustre.0 Request processed in 86us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048757.983191:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789048757.987101:0:18625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111459968:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789048757.987203:0:18625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1789048757.987218:0:18625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789048757.989804:0:18652:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789048757.989822:0:18652:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff959c3ef7b380) 00000020:00000080:0.0:1789048757.989847:0:18652:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1789048757.989922:0:18652:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959b081c1800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789048757.989927:0:18652:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959b081c1800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789048757.989929:0:18652:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959b081c1800 3 00010000:00080000:0.0:1789048757.989986:0:18652:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959c08adc000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.116@tcp at head 00010000:00010000:0.0:1789048757.991619:0:18652:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1789048757.991835:0:18652:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789048757.991875:0:18652:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789048757.991888:0:18652:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x133f221c08777180 00000100:00080000:0.0:1789048757.991898:0:18652:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789048757.991909:0:18652:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff959c08adc000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048757.991957:0:18652:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080d8a80 x1875953111460096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789048757.992011:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111460096:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789048757.992076:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048757.992134:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111460096 00000100:00100000:0.0:1789048757.992147:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111460096 00000100:00100000:0.0:1789048757.992183:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789048757.992189:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111460096:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789048757.992211:0:17122:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:0.0:1789048757.992254:0:17122:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x133f221c08777187 00000004:00100000:0.0:1789048757.992269:0:17122:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789048757.992299:0:17122:0:(import.c:65:import_set_state_nolock()) ffff959b08a49000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789048757.992369:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875953111460096:12345-0@lo:38:llog_process_th.0 Request processed in 178us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048757.992377:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789048757.992412:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959b080d8a80 x1875953111460096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789048767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048757.992423:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789048757.992430:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789048757.992436:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789048757.992441:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789048757.992443:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c08adc000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789048757.992449:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111460096:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789048757.992466:0:18652:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789048757.993007:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048757.993011:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789048757.993014:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048757.993017:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789048757.993054:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048757.993057:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789048757.993060:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048757.993062:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789048757.993308:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111460608:0@lo:400:kworker.0 00000100:00100000:1.0:1789048757.993378:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048757.993410:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789048757.993416:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111460480:0@lo:400:kworker.0 00000100:00100000:1.0:1789048757.993441:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048757.993822:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111460480 00000100:00100000:1.0:1789048757.993829:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111460480 00000100:00100000:1.0:1789048757.993870:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789048757.993878:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111460480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048757.993924:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111460480:12345-0@lo:400:kworker.0 Request processed in 47us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048757.993939:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789048757.995323:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111460480:0@lo:400:kworker.0 00000100:00100000:2.0:1789048757.995536:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111460608 00000100:00100000:2.0:1789048757.995543:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111460608 00000100:00100000:2.0:1789048757.995590:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789048757.995598:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111460608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048757.995681:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111460608:12345-0@lo:400:kworker.0 Request processed in 73us (2292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048757.995700:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1789048757.995822:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959c3fb31f80 x1875953111460608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048757.995835:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111460608:0@lo:400:kworker.0 00000100:00100000:3.0:1789048757.995948:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111460352:0@lo:400:kworker.0 00000100:00100000:3.0:1789048757.996061:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048757.996147:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111460224:0@lo:400:kworker.0 00000100:00100000:0.0:1789048757.996177:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048757.998293:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111460224 00000100:00100000:0.0:1789048757.998307:0:18100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111460224 00000100:00100000:0.0:1789048757.998370:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789048757.998379:0:18100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111460224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048757.998460:0:18100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111460224:12345-0@lo:400:kworker.0 Request processed in 83us (2282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048757.998467:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789048757.998507:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111460224:0@lo:400:kworker.0 00000020:01000004:0.0:1789048757.998606:0:18652:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789048757.998643:0:18652:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff959b088b19c0) 00000020:00000080:0.0:1789048757.998667:0:18652:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1789048757.998748:0:18652:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959b081c1800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789048757.998752:0:18652:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959b081c1800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789048757.998755:0:18652:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959b081c1800 3 00010000:00080000:0.0:1789048757.998779:0:18652:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959b08a4c800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.116@tcp at head 00010000:00010000:0.0:1789048758.000548:0:18652:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000100:00100000:2.0:1789048758.000817:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111460352 00000100:00100000:2.0:1789048758.000825:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111460352 00000100:00100000:2.0:1789048758.000864:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789048758.000871:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111460352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048758.000961:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111460352:12345-0@lo:400:kworker.0 Request processed in 81us (4890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048758.000968:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000020:00000080:0.0:1789048758.001185:0:18652:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1789048758.001222:0:18652:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789048758.001232:0:18652:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x133f221c08777195 00000100:00080000:0.0:1789048758.001238:0:18652:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789048758.001246:0:18652:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff959b08a4c800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048758.001274:0:18652:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080d9c00 x1875953111460736/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789048758.001305:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3619:1875953111460736:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789048758.001380:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048758.001425:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111460736 00000100:00100000:0.0:1789048758.001428:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111460736 00000100:00100000:0.0:1789048758.001450:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789048758.001456:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111460736:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789048758.001477:0:17122:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:0.0:1789048758.001513:0:17122:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x133f221c0877719c 00000004:00100000:0.0:1789048758.001526:0:17122:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789048758.001551:0:17122:0:(import.c:65:import_set_state_nolock()) ffff959b08a4e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789048758.001585:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875953111460736:12345-0@lo:38:llog_process_th.0 Request processed in 128us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048758.001591:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789048758.001631:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959b080d9c00 x1875953111460736/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789048767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048758.001641:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789048758.001648:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789048758.001654:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789048758.001658:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789048758.001660:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b08a4c800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789048758.001665:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3619:1875953111460736:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789048758.004452:0:18652:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789048758.004887:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048758.004894:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789048758.004896:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048758.004899:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789048758.004903:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048758.004906:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789048758.004909:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048758.004913:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1789048758.005185:0:18652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1789048758.005305:0:18625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 00010000:00080000:0.0:1789048758.005461:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959c3fb30e00 x1875953111460352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048758.005479:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111460352:0@lo:400:kworker.0 10000000:01000000:2.0:1789048758.005601:0:18625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789048758.005632:0:18625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3dc00/0x133f221c0877716b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777172 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048758.005643:0:18625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef3dc00/0x133f221c0877716b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777172 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789048758.005786:0:18625:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789048758.005789:0:18625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789048758.005790:0:18625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048758.005791:0:18625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048758.005792:0:18625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048758.005794:0:18625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048758.005796:0:18625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789048758.005797:0:18625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048758.005799:0:18625:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789048758.005802:0:18625:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789048758.005804:0:18625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789048758.005806:0:18625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789048758.005807:0:18625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048758.005808:0:18625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048758.005809:0:18625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048758.005810:0:18625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048758.005814:0:18625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789048758.005815:0:18625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048758.005816:0:18625:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789048758.005843:0:18625:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789048758.005862:0:18625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb31880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111460864:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789048758.005926:0:18625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048758.006144:0:18625:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eaa9480 going to sleep for 11 seconds 00000100:00100000:0.0:1789048758.009855:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111460864 00000100:00100000:0.0:1789048758.009870:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111460864 00000100:00100000:0.0:1789048758.009939:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789048758.010060:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:18625:x1875953111460864:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789048758.010098:0:17115:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789048758.010113:0:17115:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789048758.023106:0:17115:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789048758.023128:0:17115:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789048758.023437:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:18625:x1875953111460864:12345-0@lo:253:mount.lustre.0 Request processed in 13485us (17506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048758.023450:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789048758.023732:0:18625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb31880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:18625:1875953111460864:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789048758.023749:0:18625:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789048758.023753:0:18625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789048758.023755:0:18625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789048758.023756:0:18625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789048758.023757:0:18625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789048758.023758:0:18625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789048758.023760:0:18625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789048758.023761:0:18625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789048758.023763:0:18625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789048758.023764:0:18625:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789048758.023789:0:18625:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789048758.025210:0:17138:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789048758.025220:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789048758.025262:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff959b08364c00/0x133f221c087771a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048758.025282:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c3ef3ce00/0x133f221c087770ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087770e6 expref: 20 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048758.025292:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c3ef3c200/0x133f221c087770fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087770f4 expref: 20 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048758.025300:0:17138:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959b08364c00/0x133f221c087771a3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048758.025372:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c3ef3c200/0x133f221c087770fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c087770f4 expref: 20 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048758.025392:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c3ef3c200/0x133f221c087770fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c087770f4 expref: 20 pid: 17117 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048758.025408:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1875953111460992:0@lo:104: 00000100:00100000:0.0:1789048758.025470:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789048758.025524:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c3ef3ce00/0x133f221c087770ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c087770e6 expref: 20 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048758.025532:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c3ef3ce00/0x133f221c087770ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c087770e6 expref: 20 pid: 17116 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048758.025540:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1875953111461120:0@lo:104: 00000100:00100000:0.0:1789048758.025563:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048758.025581:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c115ed300 going to sleep for 11 seconds 00000100:00100000:0.0:1789048758.025630:0:17106:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789048758.025648:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111460992 00000100:00100000:0.0:1789048758.025655:0:17106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111460992 00000100:00100000:0.0:1789048758.025689:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111461120 00000100:00100000:0.0:1789048758.025692:0:17106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111461120 00000100:00100000:0.0:1789048758.025707:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789048758.025715:0:17106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+4:17138:x1875953111460992:12345-0@lo:104: 00010000:00010000:0.0:1789048758.025728:0:17106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c087770f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087770fb expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048758.025776:0:17106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789048758.025782:0:17106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+4:17138:x1875953111460992:12345-0@lo:104: Request processed in 68us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048758.025788:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789048758.025802:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789048758.025808:0:17106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d32ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+3:17138:x1875953111461120:12345-0@lo:104: 00010000:00010000:0.0:1789048758.025814:0:17106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087770e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087770ed expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048758.025841:0:17106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789048758.025846:0:17106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d32ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+3:17138:x1875953111461120:12345-0@lo:104: Request processed in 39us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048758.025852:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789048758.025890:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789048758.025895:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c087770f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087770fb expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048758.025902:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0600 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:0.0:1789048758.025906:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c087770f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c087770fb expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048758.025921:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c087770f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c087770fb expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048758.025928:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c087770f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c087770fb expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048758.025933:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789048758.026142:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c087770f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087770fb expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048758.026150:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789048758.026193:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111461248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048758.026239:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789048758.026282:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c087770f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087770fb expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048758.026290:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c087770f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087770fb expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048758.026302:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048758.026305:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087770e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087770ed expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048758.026310:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08364800 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:0.0:1789048758.026313:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087770e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c087770ed expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048758.026320:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087770e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c087770ed expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048758.026326:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087770e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c087770ed expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048758.026357:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789048758.026372:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087770e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087770ed expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048758.026378:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789048758.031933:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789048758.033089:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111461376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048758.033172:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048758.033249:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111461248 00000100:00100000:2.0:1789048758.033258:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111461248 00010000:00010000:2.0:1789048758.033292:0:17109:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c3ef3c200/0x133f221c087770fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087770f4 expref: 21 pid: 17117 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048758.033320:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111461376 00000100:00100000:2.0:1789048758.033324:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111461376 00010000:00010000:2.0:1789048758.033349:0:17109:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c3ef3ce00/0x133f221c087770ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087770e6 expref: 22 pid: 17116 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048758.033363:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789048758.033371:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08844e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+22:3620:x1875953111461248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048758.033408:0:17109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048758.033415:0:17109:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c3ef3c200/0x133f221c087770fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087770f4 expref: 22 pid: 17117 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048758.033427:0:17109:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c3ef3c200/0x133f221c087770fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c087770f4 expref: 22 pid: 17117 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048758.033446:0:17109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048758.033484:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08844e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+22:3620:x1875953111461248:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (7245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048758.033499:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789048758.033520:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789048758.033526:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04cb9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:3620:x1875953111461376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048758.033533:0:17109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048758.033538:0:17109:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c3ef3ce00/0x133f221c087770ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087770e6 expref: 21 pid: 17116 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048758.033547:0:17109:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c3ef3ce00/0x133f221c087770ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c087770e6 expref: 21 pid: 17116 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048758.033559:0:17109:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959b08364c00/0x133f221c087771a3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048758.033566:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b08364c00/0x133f221c087771a3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789048758.033583:0:17109:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008363484s 00010000:00010000:2.0:1789048758.033587:0:17109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959b08364c00/0x133f221c087771a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048758.033594:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959b08364c00/0x133f221c087771a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048758.033601:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff959b08364c00/0x133f221c087771a3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048758.033608:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff959b08364c00/0x133f221c087771a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048758.033614:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08364c00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048758.033658:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff959b08364c00/0x133f221c087771a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048758.033667:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff959b08364c00/0x133f221c087771a3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048758.033932:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff959b08364c00/0x133f221c087771a3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048758.033943:0:17109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048758.033982:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04cb9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:3620:x1875953111461376:12345-0@lo:103:ldlm_bl.0 Request processed in 456us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048758.033989:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789048758.034061:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111461376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048758.034072:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111461248:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048758.034708:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048758.034746:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3c200/0x133f221c087770fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c087770f4 expref: 20 pid: 17117 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048758.034759:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1875953111460992:0@lo:104: 00010000:00010000:2.0:1789048758.034771:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3ce00/0x133f221c087770ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c087770e6 expref: 19 pid: 17116 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048758.034777:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1875953111461120:0@lo:104: 00010000:00010000:2.0:1789048758.034793:0:17138:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff959b08364c00/0x133f221c087771a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048758.034802:0:17138:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff959b08364c00/0x133f221c087771a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048758.034819:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff959b08364c00/0x133f221c087771a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048758.034825:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b08364c00/0x133f221c087771a3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048758.035405:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087770e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087770ed expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048758.035416:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087770e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087770ed expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048758.039206:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048758.039213:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048758.039217:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1789048758.041742:0:18625:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789048758.044329:0:18625:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789048758.044559:0:18625:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789048758.044600:0:18625:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789048758.044653:0:18625:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789048758.044751:0:18625:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789048758.044774:0:18625:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1789048758.045798:0:18625:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789048758.046088:0:18625:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789048758.879711:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789048759.187599:0:18704:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789048759.187888:0:18704:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789048759.266843:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789048759.266866:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111461504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048759.266933:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048759.266999:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111461504 00000100:00100000:2.0:1789048759.267007:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111461504 00000100:00100000:2.0:1789048759.267062:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789048759.267072:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111461504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789048759.267105:0:17128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789048759.267148:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111461504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048759.267154:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789048759.267210:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111461504:0@lo:41:osp-pre-0-1.0 10000000:01000000:0.0:1789048759.775410:0:17119:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789048759.775417:0:17119:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c08aff800 from 9 10000000:01000000:0.0:1789048759.775422:0:17119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789048759.775466:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087771aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048759.775493:0:17119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087771aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048759.775504:0:17119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087771aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048759.775532:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111461632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789048759.775614:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048759.775663:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2aca5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789048759.776431:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789048759.776447:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111461760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048759.776481:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048759.776560:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111461760 00000100:00100000:3.0:1789048759.776568:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111461760 00000100:00100000:3.0:1789048759.776624:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789048759.776635:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111461760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789048759.776678:0:17127:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789048759.776727:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111461760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048759.776733:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789048759.776778:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111461760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048759.777315:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111461632 00000100:00100000:1.0:1789048759.777321:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111461632 00000100:00100000:1.0:1789048759.777380:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789048759.777387:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+19:17119:x1875953111461632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048759.777398:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048759.777533:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba1a00/0x133f221c087771b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087771aa expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048759.777559:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba1a00/0x133f221c087771b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087771aa expref: 20 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048759.777570:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba1a00/0x133f221c087771b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087771aa expref: 20 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048759.777578:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1a00, rc 0) 00000100:00100000:1.0:1789048759.777648:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+20:17119:x1875953111461632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 261us (2044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048759.777730:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111461632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789048759.777745:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087771aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087771b1 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048759.777755:0:17119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087771aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087771b1 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048759.777813:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111461888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789048759.777849:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048759.777878:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2aca5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789048759.777909:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789048759.777931:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111461888 00000100:00100000:1.0:1789048759.777944:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111461888 00000100:00100000:1.0:1789048759.777969:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789048759.777976:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+20:17119:x1875953111461888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789048759.777988:0:17116:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789048759.778004:0:17116:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789048759.778007:0:17116:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789048759.778086:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+20:17119:x1875953111461888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048759.778093:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789048759.778920:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111461888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789048759.778992:0:17119:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789048759.779000:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087771aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087771b1 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048759.779010:0:17119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087771aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087771b1 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048759.779030:0:17119:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789048759.779032:0:17119:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c04ca4000 from 9 10000000:01000000:2.0:1789048759.779035:0:17119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789048759.779057:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c04cb1400/0x133f221c087771b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048759.779064:0:17119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c04cb1400/0x133f221c087771b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048759.779072:0:17119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c04cb1400/0x133f221c087771b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048759.779086:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb32300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111462016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789048759.779120:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048759.779188:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41501000 going to sleep for 11 seconds 00000100:00100000:0.0:1789048759.783232:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111462016 00000100:00100000:0.0:1789048759.783246:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111462016 00000100:00100000:0.0:1789048759.783307:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789048759.783316:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+20:17119:x1875953111462016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789048759.783360:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048759.783379:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b08364c00/0x133f221c087771bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087771b8 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048759.783406:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b08364c00/0x133f221c087771bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087771b8 expref: 21 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048759.783418:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b08364c00/0x133f221c087771bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087771b8 expref: 21 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048759.783427:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08364c00, rc 0) 00000100:00100000:0.0:1789048759.783503:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:17119:x1875953111462016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (4383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048759.783510:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789048759.783565:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb32300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111462016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789048759.783582:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c04cb1400/0x133f221c087771b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087771bf expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048759.783594:0:17119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c04cb1400/0x133f221c087771b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087771bf expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048759.783777:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111462144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789048759.783816:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048759.784032:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c414be000 going to sleep for 11 seconds 00000100:00100000:3.0:1789048759.785115:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111462144 00000100:00100000:3.0:1789048759.785122:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111462144 00000100:00100000:3.0:1789048759.785152:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789048759.785159:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:17119:x1875953111462144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789048759.785180:0:17115:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789048759.785196:0:17115:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789048759.785199:0:17115:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1789048759.785274:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:17119:x1875953111462144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (1458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048759.785279:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789048759.785538:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111462144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789048759.785596:0:17119:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789048759.785614:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c04cb1400/0x133f221c087771b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087771bf expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048759.785626:0:17119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c04cb1400/0x133f221c087771b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087771bf expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048759.901530:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048760.936876:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789048761.502112:0:17877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789048761.957536:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048762.973543:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048763.108611:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048748/real 1789048748] req@ffff959b080d9500 x1875953111454976/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048763 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048763.108654:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959b080d9500 x1875953111454976/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048763 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048763.108665:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048748/real 1789048748] req@ffff959b080daa00 x1875953111455104/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048763 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048763.108675:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959b080daa00 x1875953111455104/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048763 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789048763.108696:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c414c0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048763.108717:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789048763.108731:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111454976:0@lo:8:kworker.0 00000100:00080000:2.0:1789048763.108736:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b0833b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048763.108741:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789048763.108743:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111455104:0@lo:8:kworker.0 00000100:00080000:2.0:1789048763.108819:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048763.108823:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789048763.108825:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048763.108828:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789048763.108849:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048763.108852:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789048763.108855:0:8:0:(import.c:65:import_set_state_nolock()) ffff959c414c0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048763.108860:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 503 00000100:00080000:2.0:1789048763.108865:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789048763.108875:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff959c414c0800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048763.108895:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fb31500 x1875953111462784/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789048763.108909:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048763.108912:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789048763.108913:0:8:0:(import.c:65:import_set_state_nolock()) ffff959b0833b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048763.108916:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 503 00000100:00080000:2.0:1789048763.108919:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789048763.108924:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff959b0833b800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048763.108934:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fb30000 x1875953111462912/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789048763.108980:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111462272:0@lo:400:kworker.0 00000100:00100000:2.0:1789048763.109043:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048763.109081:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111463040:0@lo:400:kworker.0 00000100:00100000:2.0:1789048763.109108:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048763.109129:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789048763.109135:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111462400:0@lo:400:kworker.0 00000100:00100000:2.0:1789048763.109156:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048763.109170:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111463168:0@lo:400:kworker.0 00000100:00100000:2.0:1789048763.109188:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048763.109210:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111462528:0@lo:400:kworker.0 00000100:00100000:2.0:1789048763.109231:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048763.109245:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111463296:0@lo:400:kworker.0 00000100:00100000:2.0:1789048763.109266:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048763.109276:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789048763.109281:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111462656:0@lo:400:kworker.0 00000100:00100000:2.0:1789048763.109298:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048763.109326:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111462272 00000100:00100000:2.0:1789048763.109353:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111462272 00000100:00100000:2.0:1789048763.109394:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789048763.109402:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:3620:x1875953111462272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048763.109446:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:3620:x1875953111462272:12345-0@lo:400:kworker.0 Request processed in 45us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048763.109453:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789048763.109501:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111463040 00000100:00100000:2.0:1789048763.109511:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111463040 00000100:00100000:2.0:1789048763.109531:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111463168 00000100:00100000:2.0:1789048763.109534:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111463168 00000100:00100000:2.0:1789048763.109560:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111462528 00000100:00100000:2.0:1789048763.109563:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111462528 00000100:00100000:2.0:1789048763.109590:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111463296 00000100:00100000:2.0:1789048763.109594:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111463296 00000100:00100000:2.0:1789048763.109609:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789048763.109615:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111463040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048763.109648:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111463040:12345-0@lo:400:kworker.0 Request processed in 33us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048763.109654:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789048763.109665:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789048763.109671:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111463168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048763.109695:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111463168:12345-0@lo:400:kworker.0 Request processed in 26us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048763.109700:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789048763.109712:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789048763.109717:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111462528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048763.109747:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111462528:12345-0@lo:400:kworker.0 Request processed in 30us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048763.109752:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789048763.109763:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789048763.109768:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111463296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048763.109792:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111463296:12345-0@lo:400:kworker.0 Request processed in 25us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048763.109797:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789048763.109822:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111462400 00000100:00100000:2.0:1789048763.109826:0:18100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111462400 00000100:00100000:2.0:1789048763.109849:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111462656 00000100:00100000:2.0:1789048763.109853:0:18100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111462656 00000100:00100000:2.0:1789048763.109865:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789048763.109869:0:18100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111462400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048763.109899:0:18100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111462400:12345-0@lo:400:kworker.0 Request processed in 29us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048763.109905:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789048763.109917:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789048763.109922:0:18100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111462656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048763.109947:0:18100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111462656:12345-0@lo:400:kworker.0 Request processed in 25us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048763.109952:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789048763.110002:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111462656:0@lo:400:kworker.0 00010000:00080000:2.0:1789048763.110014:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fb33480 x1875953111462528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048763.110025:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111462528:0@lo:400:kworker.0 00010000:00080000:2.0:1789048763.110035:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fb30380 x1875953111463296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048763.110041:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111463296:0@lo:400:kworker.0 00000100:00100000:2.0:1789048763.110067:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111462784:0@lo:8:kworker.0 00000100:00100000:2.0:1789048763.110096:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048763.110131:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111462912:0@lo:8:kworker.0 00000100:00100000:2.0:1789048763.110153:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048763.110201:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111462400:0@lo:400:kworker.0 00010000:00080000:2.0:1789048763.110210:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fb30a80 x1875953111463168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048763.110217:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111463168:0@lo:400:kworker.0 00000100:00100000:2.0:1789048763.110224:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111462272:0@lo:400:kworker.0 00010000:00080000:2.0:1789048763.110231:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fb31c00 x1875953111463040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048763.110239:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111463040:0@lo:400:kworker.0 00000100:00100000:0.0:1789048763.110554:0:18630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111462784 00000100:00100000:0.0:1789048763.110564:0:18630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111462784 00000100:00100000:0.0:1789048763.110594:0:18630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111462912 00000100:00100000:0.0:1789048763.110597:0:18630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111462912 00000100:00100000:0.0:1789048763.110609:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789048763.110614:0:18630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3619:x1875953111462784:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789048763.110694:0:18630:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:0.0:1789048763.110720:0:18630:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x133f221c087771c6 00002000:00100000:0.0:1789048763.110732:0:18630:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff959b08a4f000 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1789048763.110736:0:18630:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1789048763.110739:0:18630:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789048763.110898:0:18630:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1789048763.110918:0:18630:0:(import.c:65:import_set_state_nolock()) ffff959b08a4d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789048763.110963:0:18630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1875953111462784:12345-0@lo:8:kworker.0 Request processed in 348us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048763.110970:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789048763.110982:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789048763.110986:0:18630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3619:x1875953111462912:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789048763.110996:0:18630:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1789048763.112634:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789048763.112643:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789048763.115018:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fb31500 x1875953111462784/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789048783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048763.115034:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789048763.115046:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789048763.115059:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:2.0:1789048763.115066:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789048763.115069:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c414c0800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789048763.115094:0:3619:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789048763.115100:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111462784:0@lo:8:kworker.0 00000004:00080000:2.0:1789048763.115165:0:17865:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789048763.115184:0:17865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb31c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17865:1875953111463552:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789048763.115239:0:17865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048763.115267:0:17865:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2ae92300 going to sleep for 11 seconds 00000100:00100000:2.0:1789048763.115289:0:18631:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789048763.115295:0:18631:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789048763.115440:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111463424:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1789048763.116174:0:17864:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789048763.116272:0:17864:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 517869938033ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789048763.116280:0:17864:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789048763.117712:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048763.119902:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111463424 00000100:00100000:2.0:1789048763.119919:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111463424 00000100:00100000:2.0:1789048763.119985:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789048763.119994:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1875953111463424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789048763.120032:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789048763.120113:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1875953111463424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (4638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048763.120120:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789048763.121406:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789048763.122440:0:18632:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789048763.122460:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111463552 00000100:00100000:1.0:1789048763.122468:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111463552 00010000:00080000:2.0:1789048763.124942:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fb31500 x1875953111463424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048763.124972:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111463424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048763.127237:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789048763.127255:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17865:x1875953111463552:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789048763.127668:0:17856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:3.0:1789048763.136826:0:18912:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789048763.136849:0:18912:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1789048763.136954:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17865:x1875953111463552:12345-0@lo:7:osp-pre-0-1.0 Request processed in 9701us (21710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048763.136965:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789048763.137100:0:17865:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fb31c00 x1875953111463552/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789048779 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048763.137116:0:17865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb31c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17865:1875953111463552:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789048763.137130:0:17865:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789048763.137170:0:17865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb31c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17865:1875953111463680:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789048763.137204:0:17865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048763.137230:0:17865:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2ae92300 going to sleep for 11 seconds 00000100:00100000:2.0:1789048763.137882:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111463680 00000100:00100000:2.0:1789048763.137891:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111463680 00000100:00100000:2.0:1789048763.137937:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789048763.137945:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17865:x1875953111463680:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789048763.137972:0:18632:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1789048763.138029:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17865:x1875953111463680:12345-0@lo:5:osp-pre-0-1.0 Request processed in 85us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048763.138035:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789048763.138070:0:17865:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fb31c00 x1875953111463680/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789048779 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048763.138080:0:17865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb31c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17865:1875953111463680:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789048763.138089:0:17865:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789048763.138115:0:17865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb31c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17865:1875953111463808:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789048763.138137:0:17865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048763.138150:0:17865:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2ae92300 going to sleep for 11 seconds 00000100:00100000:3.0:1789048763.138215:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111463808 00000100:00100000:3.0:1789048763.138219:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111463808 00000100:00100000:3.0:1789048763.138247:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789048763.138253:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17865:x1875953111463808:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789048763.138277:0:18912:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1789048763.150534:0:18630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3619:x1875953111462912:12345-0@lo:8:kworker.0 Request processed in 39537us (40370us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789048763.150550:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789048763.151164:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b0833b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789048763.151171:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789048763.151175:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111462912:0@lo:8:kworker.0 00000001:00080000:1.0:1789048763.176927:0:18626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1789048763.176943:0:18626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789048763.179992:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17865:x1875953111463808:12345-0@lo:5:osp-pre-0-1.0 Request processed in 41729us (41844us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789048763.180004:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789048763.180105:0:17865:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fb31c00 x1875953111463808/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789048779 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048763.180119:0:17865:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789048763.180125:0:17865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb31c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17865:1875953111463808:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789048763.180142:0:17865:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1789048763.180193:0:17865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06973b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17865:1875953111463936:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789048763.180228:0:17865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048763.180260:0:17865:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c05d31e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789048763.180319:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111463936 00000100:00100000:3.0:1789048763.180326:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111463936 00000100:00100000:3.0:1789048763.180389:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789048763.180397:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17865:x1875953111463936:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789048763.180438:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17865:x1875953111463936:12345-0@lo:900:osp-pre-0-1.0 Request processed in 42us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048763.180444:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789048763.180584:0:17865:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b06973b80 x1875953111463936/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789048779 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048763.180594:0:17865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06973b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17865:1875953111463936:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1789048764.001366:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048764.382021:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789048764.382043:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111464064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048764.382110:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048764.382151:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111464064 00000100:00100000:2.0:1789048764.382159:0:18100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111464064 00000100:00100000:2.0:1789048764.382199:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789048764.382207:0:18100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111464064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789048764.382240:0:18100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789048764.382280:0:18100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111464064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048764.382287:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789048764.382356:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111464064:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789048764.383322:0:17157:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1789048764.821175:0:18995:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789048764.901076:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789048764.901098:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111464192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048764.901164:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048764.901215:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111464192 00000100:00100000:0.0:1789048764.901223:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111464192 00000100:00100000:0.0:1789048764.901275:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789048764.901281:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111464192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789048764.901317:0:17128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789048764.901382:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111464192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048764.901388:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789048764.901434:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111464192:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789048765.028129:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789048765.929815:0:19047:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789048765.929986:0:19047:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789048766.054233:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048767.083800:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048767.203391:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048747/real 1789048747] req@ffff959c3fb9f480 x1875953111453824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048767 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048767.203422:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959c3fb9f480 x1875953111453824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048767 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048767.203443:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048747/real 1789048747] req@ffff959c3fb9e300 x1875953111453952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048767 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048767.203455:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959c3fb9e300 x1875953111453952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048767 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789048767.203472:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789048767.203493:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789048767.203498:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111453824:0@lo:8:kworker.0 00000100:00080000:1.0:1789048767.203503:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789048767.203508:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789048767.203510:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111453952:0@lo:8:kworker.0 00000100:00080000:2.0:1789048767.204364:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048767.204370:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789048767.204380:0:8:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048767.204386:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 502 00000100:00080000:2.0:1789048767.204392:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789048767.204404:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff959c2ac8c000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048767.204426:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fb31c00 x1875953111464576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789048767.204442:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048767.204445:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789048767.204447:0:8:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048767.204450:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 502 00000100:00080000:2.0:1789048767.204452:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789048767.204456:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff959c2ac8e800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048767.204468:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fb30000 x1875953111464704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789048767.204503:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048767.204506:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789048767.204508:0:8:0:(import.c:65:import_set_state_nolock()) ffff959b0833b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048767.204511:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 517 00000100:00080000:2.0:1789048767.204514:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789048767.204518:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff959b0833b800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048767.204527:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080d8e00 x1875953111465216/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789048767.204577:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111464448:0@lo:400:kworker.0 00000100:00100000:1.0:1789048767.204950:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3622:1875953111464320:0@lo:400:kworker.0 00000100:00100000:1.0:1789048767.205018:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048767.205066:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111465088:0@lo:400:kworker.0 00000100:00100000:1.0:1789048767.205089:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048767.205172:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111464320 00000100:00100000:3.0:1789048767.205180:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111464320 00000100:00100000:3.0:1789048767.205222:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789048767.205232:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:3622:x1875953111464320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048767.205295:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:3622:x1875953111464320:12345-0@lo:400:kworker.0 Request processed in 64us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048767.205302:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789048767.205558:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3622:1875953111464320:0@lo:400:kworker.0 00000100:00100000:2.0:1789048767.205732:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048767.205773:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111465344:0@lo:400:kworker.0 00000100:00100000:2.0:1789048767.205800:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048767.205829:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111464832:0@lo:400:kworker.0 00000100:00100000:2.0:1789048767.205848:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048767.205861:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111465472:0@lo:400:kworker.0 00000100:00100000:2.0:1789048767.205876:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048767.205888:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789048767.205894:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111464960:0@lo:400:kworker.0 00000100:00100000:2.0:1789048767.205910:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048767.205924:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111465600:0@lo:400:kworker.0 00000100:00100000:2.0:1789048767.205940:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048767.205963:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111465088 00000100:00100000:2.0:1789048767.205968:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111465088 00000100:00100000:2.0:1789048767.206010:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789048767.206017:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111465088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048767.206052:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111465088:12345-0@lo:400:kworker.0 Request processed in 36us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048767.206058:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789048767.206080:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111465344 00000100:00100000:2.0:1789048767.206083:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111465344 00000100:00100000:2.0:1789048767.206097:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111464832 00000100:00100000:2.0:1789048767.206099:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111464832 00000100:00100000:2.0:1789048767.206108:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111465472 00000100:00100000:2.0:1789048767.206109:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111465472 00000100:00100000:2.0:1789048767.206120:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111465600 00000100:00100000:2.0:1789048767.206122:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111465600 00000100:00100000:2.0:1789048767.206133:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789048767.206139:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111465344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048767.206237:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111464448 00000100:00100000:1.0:1789048767.206241:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111464448 00000100:00100000:1.0:1789048767.206267:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111464960 00000100:00100000:1.0:1789048767.206270:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111464960 00000100:00100000:1.0:1789048767.206282:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789048767.206287:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111464448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048767.206322:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111464448:12345-0@lo:400:kworker.0 Request processed in 35us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048767.206369:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789048767.206382:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789048767.206388:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111464960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048767.206418:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111464960:12345-0@lo:400:kworker.0 Request processed in 31us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048767.206424:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000020:00000004:0.0:1789048767.206964:0:19098:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:2.0:1789048767.207295:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111465344:12345-0@lo:400:kworker.0 Request processed in 1155us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048767.207302:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789048767.207323:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789048767.207687:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789048767.207692:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048767.207695:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789048767.207713:0:17123:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789048767.207721:0:17123:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789048767.207737:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789048767.207746:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789048767.207754:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111465472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048767.207791:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111465472:12345-0@lo:400:kworker.0 Request processed in 38us (1912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048767.207796:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789048767.207808:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789048767.207813:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789048767.207819:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111465600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048767.207843:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111465600:12345-0@lo:400:kworker.0 Request processed in 24us (1901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048767.207848:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789048767.207876:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111464576:0@lo:8:kworker.0 00000100:00100000:3.0:1789048767.207908:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048767.207938:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111464704:0@lo:8:kworker.0 00000100:00100000:3.0:1789048767.207959:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048767.207976:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111465216:0@lo:8:kworker.0 00000100:00100000:3.0:1789048767.207998:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048767.208027:0:18630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111464576 00000100:00100000:3.0:1789048767.208033:0:18630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111464576 00000100:00100000:3.0:1789048767.208048:0:18630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111464704 00000100:00100000:3.0:1789048767.208051:0:18630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111464704 00000100:00100000:3.0:1789048767.208056:0:18630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111465216 00000100:00100000:3.0:1789048767.208058:0:18630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111465216 00000100:00100000:3.0:1789048767.208066:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789048767.208071:0:18630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3619:x1875953111464576:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789048767.208096:0:18630:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 521 last 0 00000020:00000080:3.0:1789048767.208122:0:18630:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x133f221c087771cd 00002000:00100000:3.0:1789048767.208134:0:18630:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff959b076ec800 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789048767.208138:0:18630:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789048767.208140:0:18630:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789048767.208446:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111464832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048767.208486:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111464832:12345-0@lo:400:kworker.0 Request processed in 1156us (2636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048767.208492:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789048767.208515:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789048767.208520:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3619:x1875953111464704:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789048767.208561:0:18632:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789048767.209249:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3619:x1875953111464704:12345-0@lo:8:kworker.0 Request processed in 726us (1286us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789048767.209258:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789048767.209274:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789048767.209278:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3619:x1875953111465216:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789048767.209291:0:18632:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789048767.209316:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3619:x1875953111465216:12345-0@lo:8:kworker.0 Request processed in 37us (1318us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789048767.209321:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00002000:00080000:3.0:1789048767.209756:0:18630:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789048767.209786:0:18630:0:(import.c:65:import_set_state_nolock()) ffff959b076eb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789048767.209826:0:18630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1875953111464576:12345-0@lo:8:kworker.0 Request processed in 1753us (1916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048767.209833:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:00000004:0.0:1789048767.210278:0:19098:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789048767.210717:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111464448:0@lo:400:kworker.0 00010000:00080000:2.0:1789048767.210735:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c20223480 x1875953111465344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048767.210746:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111465344:0@lo:400:kworker.0 00000100:00100000:2.0:1789048767.210815:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111464960:0@lo:400:kworker.0 00010000:00080000:2.0:1789048767.210828:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c20221500 x1875953111465600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048767.210837:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111465600:0@lo:400:kworker.0 00010000:00080000:2.0:1789048767.210847:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b080daa00 x1875953111464832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048767.210855:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111464832:0@lo:400:kworker.0 00010000:00080000:2.0:1789048767.210865:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c20222300 x1875953111465472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048767.210872:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111465472:0@lo:400:kworker.0 00010000:00080000:2.0:1789048767.210912:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b080d9c00 x1875953111465088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789048783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048767.210920:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111465088:0@lo:400:kworker.0 00010000:00080000:1.0:1789048767.211839:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fb31c00 x1875953111464576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789048792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048767.211852:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789048767.211862:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789048767.211869:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:1.0:1789048767.211875:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789048767.211878:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789048767.211910:0:3619:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789048767.211917:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111464576:0@lo:8:kworker.0 00000100:00080000:1.0:1789048767.211938:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789048767.211943:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789048767.211946:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111464704:0@lo:8:kworker.0 00000100:00080000:1.0:1789048767.211956:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b0833b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789048767.211960:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789048767.211962:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111465216:0@lo:8:kworker.0 00000004:00080000:3.0:1789048767.212516:0:17147:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:3.0:1789048767.212549:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17147:1875953111465856:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789048767.212667:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111465728:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1789048767.212737:0:17146:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789048767.212827:0:17146:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 521966493278ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789048767.212834:0:17146:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789048767.220834:0:17102:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1789048767.223723:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048767.223808:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111465728 00000100:00100000:1.0:1789048767.223824:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111465728 00000100:00100000:1.0:1789048767.223935:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789048767.223946:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875953111465728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789048767.223978:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789048767.224025:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875953111465728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048767.224031:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789048767.224071:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b08846a00 x1875953111465728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048767.224088:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111465728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048767.226403:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048767.226455:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b983c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048767.226693:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111465856 00000100:00100000:1.0:1789048767.226702:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111465856 00000100:00100000:1.0:1789048767.226747:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789048767.226756:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17147:x1875953111465856:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1789048767.233899:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1789048767.245829:0:18632:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789048767.245847:0:18632:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789048767.245855:0:18632:0:(ofd_dev.c:1497:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00010000:3.0:1789048767.263636:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048767.263651:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da99e42b/0x133f221c087771d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.263670:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1789048767.263675:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048767.263681:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da99e42b/0x133f221c087771d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.263700:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da99e42b/0x133f221c087771d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.263711:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da99e42b/0x133f221c087771d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.263719:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da99e42b/0x133f221c087771d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.263739:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789048767.264994:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048767.265008:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec101c8f/0x133f221c087771db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.265023:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1789048767.265027:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048767.265032:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec101c8f/0x133f221c087771db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.265073:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec101c8f/0x133f221c087771db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.265082:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec101c8f/0x133f221c087771db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.265090:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec101c8f/0x133f221c087771db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.265107:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789048767.266294:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789048767.266305:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da99e42b/0x133f221c087771d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.266318:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d000 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048767.266323:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da99e42b/0x133f221c087771d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.266470:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da99e42b/0x133f221c087771d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.266496:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da99e42b/0x133f221c087771d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.266509:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da99e42b/0x133f221c087771d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.266541:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048767.266545:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec101c8f/0x133f221c087771db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.266552:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048767.266555:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec101c8f/0x133f221c087771db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.266564:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec101c8f/0x133f221c087771db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.266575:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec101c8f/0x133f221c087771db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.266592:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec101c8f/0x133f221c087771db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.266604:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048767.266605:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048767.266607:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048767.266712:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048767.267112:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048767.267120:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c087771e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.267134:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1789048767.267139:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048767.267319:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c087771e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.267361:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c087771e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.267373:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c087771e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.267393:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c087771e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.267406:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789048767.267657:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048767.267665:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c087771e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.267680:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3de00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048767.267682:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c087771e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.267690:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c087771e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.267703:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c087771e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.267711:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c087771e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.267727:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048767.267729:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048767.267731:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048767.272591:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048767.272607:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c087771e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.272625:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1789048767.272630:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048767.272636:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c087771e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.272651:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c087771e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.272670:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c087771e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.272678:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c087771e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.272705:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789048767.275473:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048767.275488:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c087771e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.275504:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0a00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048767.275509:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c087771e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.275523:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c087771e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.275559:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c087771e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.275568:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c087771e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.275612:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048767.275613:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048767.275615:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048767.275841:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048767.275851:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c087771f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.275864:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1789048767.275869:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048767.275875:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c087771f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.275888:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c087771f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.275897:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c087771f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.275906:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c087771f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.275932:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789048767.280634:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048767.280651:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0cb1a46/0x133f221c087771f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.280680:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1789048767.280685:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048767.280692:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0cb1a46/0x133f221c087771f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.280708:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0cb1a46/0x133f221c087771f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.280720:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0cb1a46/0x133f221c087771f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.280729:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0cb1a46/0x133f221c087771f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.280756:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789048767.281082:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789048767.281090:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c087771f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.281100:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3da00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048767.281105:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c087771f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.281115:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c087771f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.281134:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c087771f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.281142:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5372dde/0x133f221c087771f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.281160:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048767.281170:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0cb1a46/0x133f221c087771f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.281176:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3ca00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048767.281180:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0cb1a46/0x133f221c087771f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.281188:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0cb1a46/0x133f221c087771f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.281198:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0cb1a46/0x133f221c087771f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.281205:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0cb1a46/0x133f221c087771f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.281218:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048767.281220:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048767.281222:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048767.281994:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048767.283965:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048767.283981:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fabbd379/0x133f221c087771fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.284000:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1789048767.284005:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048767.284011:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fabbd379/0x133f221c087771fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.284027:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fabbd379/0x133f221c087771fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.284058:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fabbd379/0x133f221c087771fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.284066:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fabbd379/0x133f221c087771fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.284094:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789048767.284231:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048767.284238:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fabbd379/0x133f221c087771fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.284247:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c800 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048767.284252:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fabbd379/0x133f221c087771fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.284272:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fabbd379/0x133f221c087771fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.284290:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fabbd379/0x133f221c087771fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.284299:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fabbd379/0x133f221c087771fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.284318:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048767.284320:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048767.284322:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048767.284943:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048767.284951:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029f7b11c/0x133f221c08777205 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.284962:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1789048767.284967:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048767.284971:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029f7b11c/0x133f221c08777205 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.284983:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029f7b11c/0x133f221c08777205 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.284990:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029f7b11c/0x133f221c08777205 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.284997:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029f7b11c/0x133f221c08777205 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.285069:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789048767.285324:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048767.285669:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038ee4368/0x133f221c0877720c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.285682:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1789048767.285685:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048767.285690:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038ee4368/0x133f221c0877720c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.285700:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038ee4368/0x133f221c0877720c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.285708:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038ee4368/0x133f221c0877720c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.285716:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038ee4368/0x133f221c0877720c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.286747:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789048767.286759:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029f7b11c/0x133f221c08777205 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.286769:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048767.286774:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029f7b11c/0x133f221c08777205 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.286783:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029f7b11c/0x133f221c08777205 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.286802:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029f7b11c/0x133f221c08777205 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.286809:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029f7b11c/0x133f221c08777205 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.286833:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048767.286836:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038ee4368/0x133f221c0877720c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.286841:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3ce00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048767.286857:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038ee4368/0x133f221c0877720c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.286865:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038ee4368/0x133f221c0877720c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.286875:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038ee4368/0x133f221c0877720c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.286883:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048767.286884:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048767.286886:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048767.288542:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789048767.288556:0:18632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038ee4368/0x133f221c0877720c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.288669:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048767.289317:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048767.289325:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777213 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.290250:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1789048767.290256:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048767.290263:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777213 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.290278:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777213 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.290289:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777213 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.290297:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777213 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.290322:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048767.290689:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048767.290697:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777213 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.290718:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048767.290722:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777213 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.290732:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777213 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.290751:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777213 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.290759:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777213 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.290779:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048767.290781:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048767.290782:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048767.292521:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048767.292542:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abd10f62/0x133f221c0877721a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.292559:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1789048767.292565:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048767.292571:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abd10f62/0x133f221c0877721a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.292724:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abd10f62/0x133f221c0877721a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.292751:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abd10f62/0x133f221c0877721a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.292760:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abd10f62/0x133f221c0877721a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.292813:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789048767.294885:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048767.294896:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3894d9/0x133f221c08777221 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.294913:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1789048767.294917:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048767.294922:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df3894d9/0x133f221c08777221 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.294936:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df3894d9/0x133f221c08777221 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.294946:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3894d9/0x133f221c08777221 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.294954:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df3894d9/0x133f221c08777221 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.299045:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789048767.299062:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abd10f62/0x133f221c0877721a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.299076:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048767.299081:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abd10f62/0x133f221c0877721a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.299092:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abd10f62/0x133f221c0877721a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.299122:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abd10f62/0x133f221c0877721a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.299130:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abd10f62/0x133f221c0877721a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.299364:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789048767.299586:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048767.299592:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df3894d9/0x133f221c08777221 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.299600:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c000 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048767.299604:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3894d9/0x133f221c08777221 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.299611:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3894d9/0x133f221c08777221 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.299623:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df3894d9/0x133f221c08777221 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.299629:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df3894d9/0x133f221c08777221 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.299655:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048767.299657:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048767.299658:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048767.300027:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048767.302630:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048767.302652:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777228 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.302669:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1789048767.302681:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048767.302687:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777228 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.302703:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777228 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.302713:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777228 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.302723:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777228 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048767.302749:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048767.304768:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048767.304785:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777228 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.304799:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c400 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048767.304805:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777228 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.304817:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777228 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.304839:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777228 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.304847:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777228 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.304878:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048767.304893:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048767.304895:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789048767.312251:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789048767.312265:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d1729ee/0x133f221c0877722f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.312281:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789048767.312286:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048767.312293:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d1729ee/0x133f221c0877722f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.312307:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d1729ee/0x133f221c0877722f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.312318:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d1729ee/0x133f221c0877722f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.312326:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d1729ee/0x133f221c0877722f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.312381:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048767.312393:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048767.312399:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d1729ee/0x133f221c0877722f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.312408:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048767.312413:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d1729ee/0x133f221c0877722f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.312435:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d1729ee/0x133f221c0877722f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.312453:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d1729ee/0x133f221c0877722f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.312461:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d1729ee/0x133f221c0877722f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.312480:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048767.312482:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048767.312484:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789048767.313033:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789048767.313041:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002997e870/0x133f221c08777236 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.313051:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789048767.313055:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048767.313059:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002997e870/0x133f221c08777236 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.313069:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002997e870/0x133f221c08777236 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.313077:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002997e870/0x133f221c08777236 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.313091:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002997e870/0x133f221c08777236 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.313104:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789048767.314129:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789048767.314139:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a78c6cd4/0x133f221c0877723d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.314165:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789048767.314168:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048767.314173:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a78c6cd4/0x133f221c0877723d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.314184:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a78c6cd4/0x133f221c0877723d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.314192:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a78c6cd4/0x133f221c0877723d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.314200:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a78c6cd4/0x133f221c0877723d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.314216:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789048767.314228:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789048767.314234:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002997e870/0x133f221c08777236 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.314247:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048767.314252:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002997e870/0x133f221c08777236 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.314261:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002997e870/0x133f221c08777236 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.314275:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002997e870/0x133f221c08777236 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.314284:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002997e870/0x133f221c08777236 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.314300:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048767.314303:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a78c6cd4/0x133f221c0877723d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.314310:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048767.314313:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a78c6cd4/0x133f221c0877723d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.314321:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a78c6cd4/0x133f221c0877723d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.314353:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a78c6cd4/0x133f221c0877723d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.314375:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a78c6cd4/0x133f221c0877723d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.314389:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048767.314391:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048767.314393:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048767.314400:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048767.318018:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048767.318032:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777244 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.318050:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1789048767.318055:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048767.318062:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777244 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.318077:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777244 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.318088:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777244 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.318101:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777244 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.318128:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048767.318803:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048767.318812:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777244 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.318823:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0000 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048767.318828:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777244 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.318839:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777244 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.318858:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777244 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.318866:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777244 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.318885:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048767.318888:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048767.318895:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789048767.322433:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789048767.322448:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a78c6cd4/0x133f221c0877724b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.322465:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1789048767.322470:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048767.322476:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a78c6cd4/0x133f221c0877724b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.322491:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a78c6cd4/0x133f221c0877724b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.322502:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a78c6cd4/0x133f221c0877724b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.322521:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a78c6cd4/0x133f221c0877724b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.322554:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789048767.322715:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048767.322723:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a78c6cd4/0x133f221c0877724b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.322732:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048767.322736:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a78c6cd4/0x133f221c0877724b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.322746:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a78c6cd4/0x133f221c0877724b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.322764:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a78c6cd4/0x133f221c0877724b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.322771:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a78c6cd4/0x133f221c0877724b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.322788:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048767.322790:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048767.322791:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048767.325023:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048767.325041:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002737cdda/0x133f221c08777252 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.325056:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1789048767.325060:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048767.325066:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002737cdda/0x133f221c08777252 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.325079:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002737cdda/0x133f221c08777252 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.325089:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002737cdda/0x133f221c08777252 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.325097:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002737cdda/0x133f221c08777252 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.325123:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048767.325212:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048767.325220:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002737cdda/0x133f221c08777252 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.325227:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048767.325232:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002737cdda/0x133f221c08777252 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.325250:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002737cdda/0x133f221c08777252 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.325266:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002737cdda/0x133f221c08777252 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.325273:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002737cdda/0x133f221c08777252 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048767.325291:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048767.325293:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048767.325295:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048767.326320:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048767.326482:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000556c197f/0x133f221c08777259 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.326497:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1789048767.326501:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048767.326506:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000556c197f/0x133f221c08777259 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.326827:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000556c197f/0x133f221c08777259 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.326845:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000556c197f/0x133f221c08777259 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.326852:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000556c197f/0x133f221c08777259 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.326869:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789048767.328959:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048767.328972:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c08777260 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.328988:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1789048767.328992:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048767.328997:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c08777260 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.329011:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c08777260 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.329020:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c08777260 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.329028:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c08777260 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.329058:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789048767.329801:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789048767.329812:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000556c197f/0x133f221c08777259 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.329824:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048767.329828:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000556c197f/0x133f221c08777259 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.329838:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000556c197f/0x133f221c08777259 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.329857:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000556c197f/0x133f221c08777259 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.329864:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000556c197f/0x133f221c08777259 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.329894:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048767.329898:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c08777260 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.329904:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0a00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048767.329906:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c08777260 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.329925:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c08777260 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.329935:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c08777260 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.329941:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dccf9e05/0x133f221c08777260 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.329951:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048767.329953:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048767.329954:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048767.330319:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048767.330326:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a3a1679/0x133f221c08777267 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.330359:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1789048767.330363:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048767.330376:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a3a1679/0x133f221c08777267 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.330388:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a3a1679/0x133f221c08777267 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.330396:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a3a1679/0x133f221c08777267 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.330404:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a3a1679/0x133f221c08777267 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.330420:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789048767.330523:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048767.330528:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a3a1679/0x133f221c08777267 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.330545:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048767.330555:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a3a1679/0x133f221c08777267 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.330575:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a3a1679/0x133f221c08777267 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.330586:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a3a1679/0x133f221c08777267 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.330594:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a3a1679/0x133f221c08777267 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.330608:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048767.330610:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048767.330612:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048767.331434:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048767.332606:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048767.332619:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ace5456f/0x133f221c0877726e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.332635:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1789048767.332743:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048767.332749:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ace5456f/0x133f221c0877726e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.332766:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ace5456f/0x133f221c0877726e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.332777:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ace5456f/0x133f221c0877726e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.332784:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ace5456f/0x133f221c0877726e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.332802:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789048767.334121:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048767.334132:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e025b03/0x133f221c08777275 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.334458:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1789048767.334464:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048767.334470:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e025b03/0x133f221c08777275 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.334484:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e025b03/0x133f221c08777275 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.334493:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e025b03/0x133f221c08777275 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.334520:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e025b03/0x133f221c08777275 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.334546:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789048767.336042:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789048767.336053:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ace5456f/0x133f221c0877726e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.336067:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1400 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048767.336071:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ace5456f/0x133f221c0877726e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.336082:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ace5456f/0x133f221c0877726e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.336104:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ace5456f/0x133f221c0877726e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.336119:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ace5456f/0x133f221c0877726e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.336143:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048767.336146:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e025b03/0x133f221c08777275 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.336153:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0e00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048767.336156:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e025b03/0x133f221c08777275 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.336164:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e025b03/0x133f221c08777275 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.336174:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e025b03/0x133f221c08777275 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.336181:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e025b03/0x133f221c08777275 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.336194:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048767.336196:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048767.336197:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048767.336205:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048767.337290:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048767.337303:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f20f4ae3/0x133f221c0877727c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.337317:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1789048767.337322:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048767.337327:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f20f4ae3/0x133f221c0877727c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.337355:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f20f4ae3/0x133f221c0877727c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.337376:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f20f4ae3/0x133f221c0877727c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.337384:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f20f4ae3/0x133f221c0877727c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.337406:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789048767.337900:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048767.337907:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f20f4ae3/0x133f221c0877727c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.337923:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1e00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048767.337927:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f20f4ae3/0x133f221c0877727c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.337935:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f20f4ae3/0x133f221c0877727c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.337949:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f20f4ae3/0x133f221c0877727c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.337957:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f20f4ae3/0x133f221c0877727c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.337976:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048767.337978:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048767.337980:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048767.338118:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048767.338124:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ccd2448/0x133f221c08777283 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.338151:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1789048767.338154:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048767.338159:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ccd2448/0x133f221c08777283 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.338168:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ccd2448/0x133f221c08777283 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.338176:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ccd2448/0x133f221c08777283 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.338183:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ccd2448/0x133f221c08777283 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.338200:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789048767.338455:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048767.338461:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ccd2448/0x133f221c08777283 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.338468:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048767.338471:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ccd2448/0x133f221c08777283 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.338479:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ccd2448/0x133f221c08777283 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.338496:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ccd2448/0x133f221c08777283 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.338503:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ccd2448/0x133f221c08777283 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.338557:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048767.338559:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048767.338561:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048767.338884:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048767.338890:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c0877728a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.338899:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1789048767.338902:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048767.338906:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c0877728a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.338914:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c0877728a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.338932:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c0877728a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.338939:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c0877728a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048767.338959:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789048767.338998:0:18632:0:(ofd_dev.c:1524:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:1.0:1789048767.339102:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17147:x1875953111465856:12345-0@lo:5:osp-pre-0-0.0 Request processed in 112344us (112702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048767.339111:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789048767.339502:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17147:1875953111465856:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789048767.339715:0:17147:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1789048767.339763:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17147:1875953111465984:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789048767.339802:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048767.339830:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11507480 going to sleep for 11 seconds 00010000:00010000:0.0:1789048767.339917:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048767.339924:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c0877728a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.339933:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07061600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048767.339936:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c0877728a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.339944:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c0877728a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.339960:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c0877728a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.339968:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c0877728a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048767.339998:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048767.340000:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048767.340002:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048767.340084:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111465984 00000100:00100000:1.0:1789048767.340091:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111465984 00000100:00100000:1.0:1789048767.340136:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789048767.340764:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17147:x1875953111465984:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789048767.340810:0:18912:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:2.0:1789048767.364717:0:18626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1789048767.364775:0:18626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789048767.365678:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17147:x1875953111465984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 25529us (25869us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789048767.365690:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789048767.366467:0:17147:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1789048767.366479:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17147:1875953111465984:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789048767.366495:0:17147:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:2.0:1789048768.099487:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048768.482372:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789048768.482395:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111466112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048768.482474:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048768.482719:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111466112 00000100:00100000:1.0:1789048768.482727:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111466112 00000100:00100000:1.0:1789048768.482780:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789048768.482789:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111466112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789048768.482811:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789048768.482866:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111466112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048768.482872:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789048768.483087:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111466112:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789048769.121041:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048769.515044:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111466240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048769.515116:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048769.515197:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111466240 00000100:00100000:0.0:1789048769.515205:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111466240 00000100:00100000:0.0:1789048769.515257:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789048769.515266:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111466240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789048769.515298:0:17128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789048769.524867:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111466240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 9592us (9740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048769.524883:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789048769.526225:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111466240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048770.019228:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111466368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048770.019312:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048770.019401:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111466368 00000100:00100000:1.0:1789048770.019408:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111466368 00000100:00100000:1.0:1789048770.019451:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789048770.019458:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111466368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789048770.019488:0:17127:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789048770.019540:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111466368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048770.019546:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789048770.019616:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111466368:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789048770.142565:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048771.175699:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789048771.741921:0:17877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789048772.190686:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789048772.575564:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048772.575572:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789048772.575576:0:37:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789048772.575586:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:1.0:1789048772.575593:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789048772.575608:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff959c2ac8e800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048772.575637:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b06970000 x1875953111467008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789048772.575674:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048772.575678:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789048772.575680:0:37:0:(import.c:65:import_set_state_nolock()) ffff959b0833b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789048772.575695:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 521 00000100:00080000:1.0:1789048772.575697:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789048772.575703:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff959b0833b800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048772.575716:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fb31c00 x1875953111467520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789048772.575788:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111466624:0@lo:400:kworker.0 00000100:00100000:1.0:1789048772.575879:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048772.575938:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111467264:0@lo:400:kworker.0 00000100:00100000:1.0:1789048772.575962:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048772.575979:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111467904:0@lo:400:kworker.0 00000100:00100000:1.0:1789048772.576010:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048772.576041:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789048772.576048:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111466496:0@lo:400:kworker.0 00000100:00100000:1.0:1789048772.576077:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048772.576100:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111467136:0@lo:400:kworker.0 00000100:00100000:1.0:1789048772.576120:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048772.576135:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875953111467776:0@lo:400:kworker.0 00000100:00100000:1.0:1789048772.576156:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048772.576192:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111466752:0@lo:400:kworker.0 00000100:00100000:1.0:1789048772.576216:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048772.576233:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111467392:0@lo:400:kworker.0 00000100:00100000:1.0:1789048772.576251:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048772.576268:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789048772.576274:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111466880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789048772.576295:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048772.576310:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111467648:0@lo:400:kworker.0 00000100:00100000:1.0:1789048772.576361:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048772.576389:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111467008:0@lo:8:kworker.0 00000100:00100000:1.0:1789048772.576423:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048772.576440:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111467520:0@lo:8:kworker.0 00000100:00100000:1.0:1789048772.576456:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048772.576502:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111466624 00000100:00100000:1.0:1789048772.576512:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111466624 00000100:00100000:1.0:1789048772.576560:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111467264 00000100:00100000:1.0:1789048772.576563:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111467264 00000100:00100000:1.0:1789048772.576581:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789048772.576589:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111466624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048772.576649:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111466624:12345-0@lo:400:kworker.0 Request processed in 60us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048772.576656:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789048772.576674:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789048772.576680:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111467264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048772.576706:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111467264:12345-0@lo:400:kworker.0 Request processed in 26us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048772.576711:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789048772.576733:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111466496 00000100:00100000:1.0:1789048772.576736:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111466496 00000100:00100000:1.0:1789048772.576762:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789048772.576769:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:3623:x1875953111466496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048772.576798:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:3623:x1875953111466496:12345-0@lo:400:kworker.0 Request processed in 30us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048772.576804:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789048772.576832:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111467904 00000100:00100000:1.0:1789048772.576836:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111467904 00000100:00100000:1.0:1789048772.576865:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111467136 00000100:00100000:1.0:1789048772.576873:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111467136 00000100:00100000:1.0:1789048772.576887:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111467776 00000100:00100000:1.0:1789048772.576889:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111467776 00000100:00100000:1.0:1789048772.576902:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111467648 00000100:00100000:1.0:1789048772.576904:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111467648 00000100:00100000:1.0:1789048772.576919:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789048772.576924:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111467904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048772.576954:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111467904:12345-0@lo:400:kworker.0 Request processed in 29us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048772.576960:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789048772.576970:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789048772.576975:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111467136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048772.576999:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111467136:12345-0@lo:400:kworker.0 Request processed in 24us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048772.577004:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789048772.577013:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789048772.577018:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875953111467776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048772.577042:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875953111467776:12345-0@lo:400:kworker.0 Request processed in 24us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048772.577047:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789048772.577058:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789048772.577063:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111467648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048772.577091:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111467648:12345-0@lo:400:kworker.0 Request processed in 28us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048772.577096:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789048772.577114:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111466752 00000100:00100000:1.0:1789048772.577117:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111466752 00000100:00100000:1.0:1789048772.577143:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111467392 00000100:00100000:1.0:1789048772.577145:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111467392 00000100:00100000:1.0:1789048772.577156:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111467008 00000100:00100000:1.0:1789048772.577158:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111467008 00000100:00100000:1.0:1789048772.577166:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111467520 00000100:00100000:1.0:1789048772.577168:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111467520 00000100:00100000:1.0:1789048772.577176:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789048772.577182:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111466752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048772.577212:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111466752:12345-0@lo:400:kworker.0 Request processed in 31us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048772.577217:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789048772.577228:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789048772.577234:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111467392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048772.577258:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111467392:12345-0@lo:400:kworker.0 Request processed in 25us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048772.577264:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789048772.577274:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789048772.577278:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3619:x1875953111467008:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789048772.577299:0:18632:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789048772.584927:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789048772.584943:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3619:x1875953111467520:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789048772.584978:0:18912:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789048772.585943:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3619:x1875953111467520:12345-0@lo:8:kworker.0 Request processed in 996us (9480us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789048772.585954:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789048772.586106:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111466880 00000100:00100000:0.0:1789048772.586116:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111466880 00000100:00100000:0.0:1789048772.586172:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789048772.586659:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111466880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789048772.586706:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789048772.586758:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111466880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (10461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048772.586774:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789048772.590413:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789048772.590427:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789048772.590432:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789048772.590509:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111466496:0@lo:400:kworker.0 00010000:00080000:0.0:1789048772.590536:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b06971c00 x1875953111467136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048772.590549:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111467136:0@lo:400:kworker.0 00010000:00080000:0.0:1789048772.590564:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fb30700 x1875953111467776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048772.590572:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875953111467776:0@lo:400:kworker.0 00000100:00100000:0.0:1789048772.590586:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111466624:0@lo:400:kworker.0 00000100:00100000:0.0:1789048772.590598:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111467264:0@lo:400:kworker.0 00010000:00080000:0.0:1789048772.590612:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b0820c380 x1875953111467904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048772.590622:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111467904:0@lo:400:kworker.0 00000100:00100000:0.0:1789048772.592461:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111466880:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789048772.592494:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fb32d80 x1875953111467648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048772.592536:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111467648:0@lo:400:kworker.0 00000100:00100000:0.0:1789048772.592553:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111466752:0@lo:400:kworker.0 00000100:00100000:0.0:1789048772.592564:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111467392:0@lo:400:kworker.0 00000100:00080000:0.0:1789048772.594439:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b0833b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789048772.594455:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789048772.594461:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111467520:0@lo:8:kworker.0 00000100:00100000:1.0:1789048772.625048:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3619:x1875953111467008:12345-0@lo:8:kworker.0 Request processed in 47755us (48611us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789048772.625067:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789048772.625140:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789048772.625147:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789048772.625151:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111467008:0@lo:8:kworker.0 00010000:00010000:0.0:1789048773.216665:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048773.600497:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789048773.600518:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111468032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789048773.600599:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048773.600680:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111468032 00000100:00100000:0.0:1789048773.600688:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111468032 00000100:00100000:0.0:1789048773.600744:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789048773.600755:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111468032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789048773.600778:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789048773.600839:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111468032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048773.600847:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789048773.601085:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111468032:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789048774.240908:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048774.625038:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111468160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789048774.625124:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048774.625198:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111468160 00000100:00100000:0.0:1789048774.625206:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111468160 00000100:00100000:0.0:1789048774.625253:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789048774.625260:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111468160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789048774.625295:0:17128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789048774.625350:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111468160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048774.625367:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789048774.634312:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111468160:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1789048774.639800:0:17157:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1789048774.813526:0:19444:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789048774.813530:0:19444:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789048774.813531:0:19444:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789048774.814242:0:19444:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff959c3fb95000 00000020:01000004:0.0:1789048774.814259:0:19444:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789048774.814274:0:19444:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789048774.814288:0:19444:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff959b088b0000) 00000020:00000080:0.0:1789048774.814306:0:19444:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789048774.898658:0:19444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789048774.899252:0:19444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789048774.899655:0:19444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789048774.900056:0:19444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789048774.900272:0:19444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789048774.900569:0:19444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789048774.901036:0:19444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1789048774.906908:0:19444:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789048774.907147:0:19444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789048774.907161:0:19444:0:(osd_handler.c:8921:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789048774.907174:0:19444:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x133f221c08777298 00000020:01000004:3.0:1789048774.907182:0:19444:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789048774.907204:0:19444:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789048774.907208:0:19444:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789048774.907214:0:19444:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789048774.907242:0:19444:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789048774.907246:0:19444:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789048774.925254:0:19444:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789048774.925291:0:19444:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.116@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789048774.925295:0:19444:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789048774.925297:0:19444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789048774.925298:0:19444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048774.925299:0:19444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048774.925301:0:19444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048774.925302:0:19444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048774.925304:0:19444:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789048774.925305:0:19444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048774.925306:0:19444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789048774.925310:0:19444:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789048774.925312:0:19444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789048774.925313:0:19444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789048774.925314:0:19444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048774.925315:0:19444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048774.925316:0:19444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048774.925317:0:19444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048774.925318:0:19444:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789048774.925319:0:19444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048774.925320:0:19444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789048774.925747:0:19444:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789048774.925768:0:19444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111468288:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789048774.925846:0:19444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048774.925947:0:19444:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c414beb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789048774.926030:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111468288 00000100:00100000:2.0:1789048774.926039:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111468288 00000100:00100000:2.0:1789048774.926138:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789048774.926149:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:19444:x1875953111468288:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789048774.926180:0:17115:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789048774.926183:0:17115:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789048774.926188:0:17115:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789048774.927649:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:19444:x1875953111468288:12345-0@lo:253:mount.lustre.0 Request processed in 1492us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048774.927663:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789048774.928323:0:19444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111468288:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789048774.928360:0:19444:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789048774.928363:0:19444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789048774.928364:0:19444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789048774.928366:0:19444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048774.928367:0:19444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048774.928368:0:19444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048774.928369:0:19444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048774.928371:0:19444:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789048774.928373:0:19444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048774.928374:0:19444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789048774.928397:0:19444:0:(tgt_mount.c:101:server_register_mount()) register mount ffff959c3fb95000 from lustre-OST0001 10000000:01000000:0.0:1789048774.928446:0:19444:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789048774.928449:0:19444:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789048774.928693:0:19444:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff959c20228000 local copy 00010000:00010000:0.0:1789048774.928705:0:19444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365600/0x133f221c08776eee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776ef5 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048774.928809:0:19444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111468416:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048774.928855:0:19444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048774.928958:0:19444:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789048774.929029:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111468416 00000100:00100000:2.0:1789048774.929037:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111468416 00000100:00100000:2.0:1789048774.929083:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789048774.929103:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:19444:x1875953111468416:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048774.929196:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:19444:x1875953111468416:12345-0@lo:501:mount.lustre.0 Request processed in 104us (340us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789048774.929203:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789048774.929282:0:19444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111468416:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789048774.929296:0:19444:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789048774.929314:0:19444:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789048774.929321:0:19444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365600/0x133f221c08776eee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776ef5 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048774.929366:0:19444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b08365600/0x133f221c08776eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776ef5 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048774.929400:0:19444:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff959c3fb95000 10000000:01000000:0.0:1789048774.929405:0:19444:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789048774.929411:0:19444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789048774.929413:0:19444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789048774.929417:0:19444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789048774.929420:0:19444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789048774.929443:0:19444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365a00/0x133f221c0877729f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048774.929451:0:19444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b08365a00/0x133f221c0877729f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048774.929473:0:19444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b08365a00/0x133f221c0877729f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048774.929486:0:19444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111468544:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789048774.929525:0:19444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048774.929542:0:19444:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789048774.929919:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111468544 00000100:00100000:1.0:1789048774.929926:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111468544 00000100:00100000:1.0:1789048774.929950:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789048774.929958:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:19444:x1875953111468544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789048774.929968:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048774.929981:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c07060000/0x133f221c087772a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c0877729f expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048774.930004:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c07060000/0x133f221c087772a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c0877729f expref: 22 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048774.930014:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c07060000/0x133f221c087772a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c0877729f expref: 22 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048774.930023:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07060000, rc 0) 00000100:00100000:1.0:1789048774.930055:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+22:19444:x1875953111468544:12345-0@lo:101:mount.lustre.0 Request processed in 97us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048774.930061:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789048774.930247:0:19444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111468544:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789048774.930262:0:19444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b08365a00/0x133f221c0877729f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087772a6 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048774.930272:0:19444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b08365a00/0x133f221c0877729f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087772a6 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789048774.932208:0:19444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789048774.933036:0:19444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789048774.940970:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789048774.941028:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789048774.941047:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789048774.941062:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789048774.941076:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789048774.941092:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789048774.941127:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789048774.941134:0:19444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789048774.941246:0:19444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20221500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111468672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048774.941310:0:19444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048774.941390:0:19444:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2a562000 going to sleep for 11 seconds 00000100:00100000:3.0:1789048774.941982:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111468672 00000100:00100000:3.0:1789048774.941991:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111468672 00000100:00100000:3.0:1789048774.942047:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789048774.942058:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+22:19444:x1875953111468672:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048774.942228:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+22:19444:x1875953111468672:12345-0@lo:501:mount.lustre.0 Request processed in 171us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048774.942236:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789048774.942403:0:19444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20221500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111468672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048774.942450:0:19444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111468800:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789048774.942518:0:19444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048774.942539:0:19444:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef3e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048774.942886:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111468800 00000100:00100000:3.0:1789048774.942892:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111468800 00000100:00100000:3.0:1789048774.942926:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789048774.942933:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+22:19444:x1875953111468800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789048774.944049:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+22:19444:x1875953111468800:12345-0@lo:503:mount.lustre.0 Request processed in 1113us (1538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048774.944060:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789048774.944201:0:19444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111468800:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789048774.944921:0:19444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789048774.945004:0:19444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111468928:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048774.945052:0:19444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048774.945084:0:19444:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef3e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048774.945313:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111468928 00000100:00100000:3.0:1789048774.945320:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111468928 00000100:00100000:3.0:1789048774.945370:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789048774.945387:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+22:19444:x1875953111468928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048774.947322:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+22:19444:x1875953111468928:12345-0@lo:502:mount.lustre.0 Request processed in 1928us (2260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048774.947348:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789048774.947768:0:19444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111468928:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789048774.947986:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789048774.948017:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789048774.948035:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789048774.948049:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789048774.948061:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789048774.948088:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789048774.948180:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789048774.948198:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789048774.948213:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1789048774.948248:0:19444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111469056:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048774.948304:0:19444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048774.948421:0:19444:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef3e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048774.948705:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111469056 00000100:00100000:2.0:1789048774.948714:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111469056 00000100:00100000:2.0:1789048774.948796:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789048774.948806:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+22:19444:x1875953111469056:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789048774.948932:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+22:19444:x1875953111469056:12345-0@lo:502:mount.lustre.0 Request processed in 127us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048774.948939:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789048774.949035:0:19444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111469056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789048774.949093:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789048774.949117:0:19444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1789048774.950167:0:19448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789048774.950176:0:19448:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789048774.950182:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048774.950185:0:19448:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789048774.950190:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789048774.950210:0:19448:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff959c3945b380) 00000020:00000080:1.0:1789048774.950235:0:19448:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789048774.950242:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789048774.950319:0:19448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c3fb95000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789048774.950327:0:19448:0:(osd_handler.c:8921:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789048774.950371:0:19448:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x133f221c087772b4 00010000:00010000:1.0:1789048774.953407:0:19448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1789048774.962312:0:19448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1789048774.967892:0:19448:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1789048774.970059:0:19448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789048774.970072:0:19448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048774.970080:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048774.970082:0:19448:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789048774.970085:0:19448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048774.970089:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048774.970090:0:19448:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789048774.970092:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789048774.970094:0:19448:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789048774.970096:0:19448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048774.970098:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048774.970099:0:19448:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789048774.970102:0:19448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048774.970104:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048774.970105:0:19448:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789048774.970109:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789048774.970135:0:19448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048774.970138:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048774.970139:0:19448:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789048774.970142:0:19448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1789048774.975565:0:19444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789048774.975725:0:19444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789048774.976694:0:19444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365a00/0x133f221c0877729f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087772a6 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048774.976710:0:19444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b08365a00/0x133f221c0877729f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087772a6 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048774.976727:0:19444:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c3fb95000 from 1 10000000:01000000:0.0:1789048774.976730:0:19444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789048774.976769:0:19444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c087772bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048774.976776:0:19444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c087772bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048774.976787:0:19444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c087772bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048774.976812:0:19444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111469184:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789048774.976878:0:19444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048774.976921:0:19444:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef3ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789048774.977550:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111469184 00000100:00100000:1.0:1789048774.977559:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111469184 00000100:00100000:1.0:1789048774.977618:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789048774.977628:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+22:19444:x1875953111469184:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789048774.977642:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048774.977655:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c07061000/0x133f221c087772c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087772bb expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048774.977680:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c07061000/0x133f221c087772c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087772bb expref: 23 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048774.977691:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c07061000/0x133f221c087772c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087772bb expref: 23 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048774.977699:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07061000, rc 0) 00000100:00100000:1.0:1789048774.977746:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:19444:x1875953111469184:12345-0@lo:101:mount.lustre.0 Request processed in 119us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048774.977752:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789048774.977805:0:19444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111469184:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789048774.977819:0:19444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c087772bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087772c2 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048774.977828:0:19444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c087772bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087772c2 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789048774.979324:0:19444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789048774.979858:0:19444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789048774.980031:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789048774.980053:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789048774.980068:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789048774.980072:0:19444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789048774.980136:0:19444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111469312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789048774.980192:0:19444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048774.980285:0:19444:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c20891600 going to sleep for 11 seconds 00000100:00100000:0.0:1789048774.981326:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111469312 00000100:00100000:0.0:1789048774.981639:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111469312 00000100:00100000:0.0:1789048774.981872:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789048774.981884:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:19444:x1875953111469312:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048774.982028:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:19444:x1875953111469312:12345-0@lo:501:mount.lustre.0 Request processed in 146us (1835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048774.982036:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789048774.982110:0:19444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111469312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048774.982154:0:19444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20223480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111469440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789048774.982203:0:19444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048774.982289:0:19444:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c034fd900 going to sleep for 11 seconds 00000100:00100000:1.0:1789048774.982405:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111469440 00000100:00100000:1.0:1789048774.982410:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111469440 00000100:00100000:1.0:1789048774.982431:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789048774.982438:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c489050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:19444:x1875953111469440:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789048774.982536:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c489050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:19444:x1875953111469440:12345-0@lo:503:mount.lustre.0 Request processed in 98us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048774.982542:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789048774.982641:0:19444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20223480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111469440:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789048774.982990:0:19444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789048774.983050:0:19444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20223480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111469568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789048774.983087:0:19444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048774.983110:0:19444:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c034fd900 going to sleep for 11 seconds 00000100:00100000:1.0:1789048774.983294:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111469568 00000100:00100000:1.0:1789048774.983299:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111469568 00000100:00100000:1.0:1789048774.983321:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789048774.983326:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:19444:x1875953111469568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789048774.983437:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:19444:x1875953111469568:12345-0@lo:502:mount.lustre.0 Request processed in 109us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048774.983444:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789048774.983545:0:19444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20223480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111469568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789048774.983744:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789048774.983773:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789048774.983787:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789048774.983811:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789048774.983824:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789048774.983838:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789048774.983853:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789048774.983865:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1789048774.983879:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789048774.983893:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1789048774.983907:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1789048774.983929:0:19444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20223480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111469696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789048774.983964:0:19444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048774.983989:0:19444:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c034fd900 going to sleep for 11 seconds 00000100:00100000:1.0:1789048774.984144:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111469696 00000100:00100000:1.0:1789048774.984151:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111469696 00000100:00100000:1.0:1789048774.984174:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789048774.984188:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:19444:x1875953111469696:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789048774.984267:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:19444:x1875953111469696:12345-0@lo:502:mount.lustre.0 Request processed in 80us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048774.984275:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789048774.984373:0:19444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20223480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111469696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789048774.984414:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1789048774.984423:0:19444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789048774.985297:0:19452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048774.985308:0:19452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048774.985311:0:19452:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789048774.985317:0:19452:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959c3fb95000 00000020:00000080:1.0:1789048774.985320:0:19452:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789048774.985328:0:19452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048774.989115:0:19452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048774.989125:0:19452:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789048774.989141:0:19452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048774.989168:0:19452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048774.989169:0:19452:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789048774.989175:0:19452:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959c3fb95000 00000020:00000080:1.0:1789048774.989178:0:19452:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789048774.989547:0:19452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048774.989571:0:19452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048774.989573:0:19452:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789048774.989687:0:19452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048774.989694:0:19452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048774.989695:0:19452:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789048774.989700:0:19452:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959c3fb95000 00000020:00000080:1.0:1789048774.989703:0:19452:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789048774.991637:0:19452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048774.991650:0:19452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048774.991652:0:19452:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789048774.992211:0:19452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048774.992218:0:19452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048774.992220:0:19452:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789048774.992225:0:19452:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959c3fb95000 00000020:00000080:1.0:1789048774.992234:0:19452:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789048774.992294:0:19452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048774.992297:0:19452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048774.992298:0:19452:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789048774.992302:0:19452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1789048774.992936:0:19444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789048774.992970:0:19444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789048774.992993:0:19444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c087772bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087772c2 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048774.993006:0:19444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c087772bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087772c2 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048774.993069:0:19444:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789048774.993072:0:19444:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff959c3fb95000 10000000:01000000:0.0:1789048774.993075:0:19444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff959c3fb95000 10000000:01000000:0.0:1789048774.993078:0:19444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789048774.993085:0:19444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959c3fb95000 from 1 10000000:01000000:0.0:1789048774.993087:0:19444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789048774.993122:0:19444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08364a00/0x133f221c087772c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048774.993130:0:19444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b08364a00/0x133f221c087772c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048774.993141:0:19444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b08364a00/0x133f221c087772c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048774.993164:0:19444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111469824:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789048774.993229:0:19444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048774.993272:0:19444:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef3ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789048774.993473:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111469824 00000100:00100000:1.0:1789048774.993481:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111469824 00000100:00100000:1.0:1789048774.993721:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789048774.993733:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:19444:x1875953111469824:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789048774.993746:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048774.993760:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c07061a00/0x133f221c087772d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087772c9 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048774.993781:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c07061a00/0x133f221c087772d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087772c9 expref: 24 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048774.993791:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c07061a00/0x133f221c087772d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087772c9 expref: 24 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048774.993800:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07061a00, rc 0) 00000100:00100000:1.0:1789048774.993929:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:19444:x1875953111469824:12345-0@lo:101:mount.lustre.0 Request processed in 199us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048774.993937:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789048775.005270:0:19444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111469824:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789048775.005305:0:19444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b08364a00/0x133f221c087772c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087772d0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048775.005319:0:19444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b08364a00/0x133f221c087772c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087772d0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789048775.007797:0:19444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1789048775.008086:0:19444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789048775.008277:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789048775.008302:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789048775.008320:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789048775.011762:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789048775.011822:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789048775.011839:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789048775.011855:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789048775.011882:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789048775.011897:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789048775.011911:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789048775.011925:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789048775.011939:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789048775.011952:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789048775.011965:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789048775.011979:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789048775.011993:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789048775.012007:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789048775.012022:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789048775.012034:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789048775.012049:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789048775.012064:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789048775.012097:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789048775.012114:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789048775.012129:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789048775.012143:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1789048775.012158:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1789048775.012173:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1789048775.012186:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1789048775.012201:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1789048775.012217:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1789048775.012230:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1789048775.012243:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1789048775.012257:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1789048775.012271:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1789048775.012286:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1789048775.012299:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1789048775.012312:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1789048775.012366:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1789048775.012386:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1789048775.012400:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1789048775.012426:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1789048775.012443:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1789048775.012472:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1789048775.012488:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1789048775.012502:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1789048775.012810:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1789048775.012837:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1789048775.012843:0:19444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1789048775.012948:0:19444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20223480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111469952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048775.013010:0:19444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048775.013054:0:19444:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c034fdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789048775.013114:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111469952 00000100:00100000:3.0:1789048775.013123:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111469952 00000100:00100000:3.0:1789048775.013176:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789048775.013186:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:19444:x1875953111469952:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048775.013312:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:19444:x1875953111469952:12345-0@lo:501:mount.lustre.0 Request processed in 127us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048775.013327:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789048775.017373:0:19444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20223480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111469952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048775.017438:0:19444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20223480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111470080:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789048775.017533:0:19444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048775.017585:0:19444:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c034fdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789048775.020750:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111470080 00000100:00100000:0.0:1789048775.020766:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111470080 00000100:00100000:0.0:1789048775.020820:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789048775.020830:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:19444:x1875953111470080:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789048775.020983:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:19444:x1875953111470080:12345-0@lo:503:mount.lustre.0 Request processed in 153us (3449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048775.020991:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789048775.021143:0:19444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20223480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111470080:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789048775.021738:0:19444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789048775.021827:0:19444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111470208:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048775.021877:0:19444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048775.021904:0:19444:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef3e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789048775.021924:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111470208 00000100:00100000:0.0:1789048775.021929:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111470208 00000100:00100000:0.0:1789048775.021958:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789048775.021965:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:19444:x1875953111470208:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048775.022052:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:19444:x1875953111470208:12345-0@lo:502:mount.lustre.0 Request processed in 87us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048775.022060:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789048775.022104:0:19444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111470208:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789048775.022263:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789048775.022290:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789048775.022305:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789048775.022320:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789048775.022359:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789048775.022375:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789048775.022388:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789048775.022402:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789048775.022416:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789048775.022429:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789048775.022442:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789048775.022484:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789048775.022501:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789048775.023742:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789048775.023766:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789048775.023784:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789048775.023797:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789048775.023810:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789048775.023837:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789048775.023853:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789048775.023866:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789048775.023877:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789048775.023889:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789048775.023904:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789048775.023918:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1789048775.023930:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1789048775.023943:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1789048775.023974:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1789048775.023990:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1789048775.024004:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1789048775.024016:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1789048775.024029:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1789048775.024041:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1789048775.024054:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1789048775.024069:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1789048775.024083:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1789048775.024095:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1789048775.024107:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1789048775.024118:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1789048775.024132:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1789048775.024144:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1789048775.024157:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1789048775.024169:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1789048775.024197:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1789048775.024212:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1789048775.024227:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1789048775.024240:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1789048775.024252:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1789048775.024303:0:19444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111470336:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048775.026719:0:19444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048775.026784:0:19444:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88900 going to sleep for 11 seconds 00000100:00100000:3.0:1789048775.026922:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111470336 00000100:00100000:3.0:1789048775.026931:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111470336 00000100:00100000:3.0:1789048775.026985:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789048775.026994:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:19444:x1875953111470336:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048775.027130:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:19444:x1875953111470336:12345-0@lo:502:mount.lustre.0 Request processed in 136us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048775.027137:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789048775.027879:0:19444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111470336:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789048775.028092:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1789048775.028120:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1789048775.028155:0:19444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111470464:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048775.028207:0:19444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048775.028238:0:19444:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88900 going to sleep for 11 seconds 00000100:00100000:0.0:1789048775.028258:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111470464 00000100:00100000:0.0:1789048775.028263:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111470464 00000100:00100000:0.0:1789048775.028295:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789048775.028301:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:19444:x1875953111470464:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048775.028413:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:19444:x1875953111470464:12345-0@lo:502:mount.lustre.0 Request processed in 111us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048775.028421:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789048775.028476:0:19444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111470464:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789048775.030856:0:19444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1789048775.030880:0:19444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789048775.033846:0:19457:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789048775.033865:0:19457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff959b088b3380) 00000020:00000080:0.0:1789048775.033891:0:19457:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1789048775.034003:0:19457:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c3fb95000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789048775.034007:0:19457:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959c3fb95000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789048775.034010:0:19457:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c3fb95000 3 00010000:00080000:0.0:1789048775.034049:0:19457:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959b07620000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.116@tcp at head 00010000:00010000:0.0:1789048775.037434:0:19457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1789048775.037810:0:19457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789048775.037857:0:19457:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789048775.037876:0:19457:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x133f221c087772de 00000100:00080000:0.0:1789048775.037887:0:19457:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789048775.037899:0:19457:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff959b07620000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048775.037936:0:19457:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fb9d500 x1875953111470592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789048775.038009:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111470592:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789048775.038078:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789048775.038667:0:19457:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789048775.038855:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789048775.038860:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789048775.038862:0:36:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789048775.038867:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 527 00000100:00080000:3.0:1789048775.038871:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789048775.038878:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff959c2ac8e800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048775.038891:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b08845f80 x1875953111470976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789048775.039631:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111470720:0@lo:400:kworker.0 00000100:00100000:0.0:1789048775.039689:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048775.039724:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789048775.039731:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111470848:0@lo:400:kworker.0 00000100:00100000:0.0:1789048775.039757:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048775.039790:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111470720 00000100:00100000:0.0:1789048775.039797:0:18100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111470720 00000100:00100000:0.0:1789048775.039840:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789048775.039849:0:18100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111470720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048775.039900:0:18100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111470720:12345-0@lo:400:kworker.0 Request processed in 52us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048775.039907:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789048775.039929:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111470848 00000100:00100000:0.0:1789048775.039933:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111470848 00000100:00100000:0.0:1789048775.039967:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789048775.039976:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111470848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048775.040007:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111470848:12345-0@lo:400:kworker.0 Request processed in 33us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048775.040013:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789048775.040032:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789048775.040061:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111470848:0@lo:400:kworker.0 00000100:00100000:0.0:1789048775.040082:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111470720:0@lo:400:kworker.0 00000100:00100000:1.0:1789048775.040286:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111470976:0@lo:8:kworker.0 00000100:00100000:1.0:1789048775.040317:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048775.040379:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111470592 00000100:00100000:1.0:1789048775.040384:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111470592 00000100:00100000:1.0:1789048775.040416:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789048775.040422:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875953111470592:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789048775.040444:0:17124:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:1.0:1789048775.040488:0:17124:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x133f221c087772e5 00000100:00100000:2.0:1789048775.040649:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111470976 00000100:00100000:2.0:1789048775.040654:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111470976 00000100:00100000:2.0:1789048775.040681:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789048775.040686:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3619:x1875953111470976:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789048775.040733:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3619:x1875953111470976:12345-0@lo:8:kworker.0 Request processed in 46us (415us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789048775.040739:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00100000:1.0:1789048775.040834:0:17124:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789048775.040866:0:17124:0:(import.c:65:import_set_state_nolock()) ffff959c2a76a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789048775.040903:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875953111470592:12345-0@lo:38:llog_process_th.0 Request processed in 480us (2825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048775.040910:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789048775.041088:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789048775.041095:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789048775.041099:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789048775.041102:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111470976:0@lo:8:kworker.0 00010000:00080000:1.0:1789048775.041115:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fb9d500 x1875953111470592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789048785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048775.041124:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789048775.041130:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789048775.041137:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789048775.041142:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789048775.041145:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b07620000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789048775.041150:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111470592:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789048775.041414:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789048775.041419:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789048775.041421:0:36:0:(import.c:65:import_set_state_nolock()) ffff959b0833b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789048775.041426:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 527 00000100:00080000:3.0:1789048775.041429:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789048775.041436:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff959b0833b800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048775.041450:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b08845180 x1875953111471360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048775.041552:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111471104:0@lo:400:kworker.0 00000100:00100000:1.0:1789048775.041727:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111471360:0@lo:8:kworker.0 00000100:00100000:1.0:1789048775.041755:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048775.041823:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048775.041852:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111471744:0@lo:400:kworker.0 00000100:00100000:3.0:1789048775.041879:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048775.041897:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789048775.041902:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111471232:0@lo:400:kworker.0 00000100:00100000:3.0:1789048775.041922:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048775.041948:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111471104 00000100:00100000:3.0:1789048775.041954:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111471104 00000100:00100000:3.0:1789048775.041984:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111471744 00000100:00100000:3.0:1789048775.041986:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111471744 00000100:00100000:3.0:1789048775.042009:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789048775.042017:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111471104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048775.042053:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111471104:12345-0@lo:400:kworker.0 Request processed in 37us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048775.042060:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789048775.042072:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789048775.042078:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111471744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048775.042104:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111471744:12345-0@lo:400:kworker.0 Request processed in 26us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048775.042109:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1789048775.042134:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b08846d80 x1875953111471104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048775.042145:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111471104:0@lo:400:kworker.0 00010000:00080000:3.0:1789048775.042155:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b08844e00 x1875953111471744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048775.042170:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111471744:0@lo:400:kworker.0 00000100:00100000:3.0:1789048775.042191:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875953111471616:0@lo:400:kworker.0 00000100:00100000:3.0:1789048775.042219:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048775.042236:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789048775.042241:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111471488:0@lo:400:kworker.0 00000100:00100000:3.0:1789048775.042262:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048775.042279:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111471616 00000100:00100000:3.0:1789048775.042283:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111471616 00000100:00100000:3.0:1789048775.042300:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111471488 00000100:00100000:3.0:1789048775.042303:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111471488 00000100:00100000:3.0:1789048775.042314:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789048775.042319:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875953111471616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048775.042378:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875953111471616:12345-0@lo:400:kworker.0 Request processed in 59us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048775.042385:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789048775.042397:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789048775.042403:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111471488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048775.042429:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111471488:12345-0@lo:400:kworker.0 Request processed in 26us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048775.042434:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789048775.042467:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b08845f80 x1875953111471488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048775.042476:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111471488:0@lo:400:kworker.0 00010000:00080000:3.0:1789048775.042486:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b08846a00 x1875953111471616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048775.042500:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875953111471616:0@lo:400:kworker.0 00000100:00080000:3.0:1789048775.042709:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048775.042713:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048775.042723:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111471360 00000100:00100000:3.0:1789048775.042727:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111471360 00000100:00100000:3.0:1789048775.042752:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111471232 00000100:00100000:3.0:1789048775.042755:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111471232 00000100:00100000:3.0:1789048775.042782:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789048775.042788:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111471232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048775.042823:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111471232:12345-0@lo:400:kworker.0 Request processed in 35us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048775.042828:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789048775.042839:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789048775.042843:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3619:x1875953111471360:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789048775.042883:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3619:x1875953111471360:12345-0@lo:8:kworker.0 Request processed in 39us (1127us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789048775.042888:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789048775.042916:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111471232:0@lo:400:kworker.0 00000100:00080000:3.0:1789048775.042929:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789048775.043841:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789048775.043850:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b0833b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789048775.043860:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789048775.043864:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111471360:0@lo:8:kworker.0 00000020:01000004:0.0:1789048775.046749:0:19457:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789048775.046766:0:19457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff959b088b4d40) 00000020:00000080:0.0:1789048775.046793:0:19457:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1789048775.046870:0:19457:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c3fb95000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789048775.046875:0:19457:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959c3fb95000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789048775.046877:0:19457:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c3fb95000 3 00010000:00080000:0.0:1789048775.046909:0:19457:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959b07589000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.116@tcp at head 00010000:00010000:0.0:1789048775.048573:0:19457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1789048775.050558:0:19457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789048775.050721:0:19457:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789048775.050738:0:19457:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x133f221c087772f3 00000100:00080000:0.0:1789048775.050749:0:19457:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789048775.050761:0:19457:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff959b07589000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048775.050798:0:19457:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fb9ed80 x1875953111471872/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789048775.050828:0:19457:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789048775.052871:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3619:1875953111471872:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789048775.052952:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048775.053053:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111471872 00000100:00100000:0.0:1789048775.053062:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111471872 00000100:00100000:0.0:1789048775.053107:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789048775.053114:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1875953111471872:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789048775.053142:0:19099:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:0.0:1789048775.053191:0:19099:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x133f221c087772fa 00000004:00100000:0.0:1789048775.053207:0:19099:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789048775.053239:0:19099:0:(import.c:65:import_set_state_nolock()) ffff959c08ad9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789048775.053294:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875953111471872:12345-0@lo:38:llog_process_th.0 Request processed in 178us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048775.053307:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789048775.053442:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fb9ed80 x1875953111471872/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789048785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048775.053453:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789048775.053474:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789048775.053489:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789048775.053494:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789048775.053497:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b07589000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789048775.053503:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3619:1875953111471872:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789048775.055438:0:19457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1789048775.055622:0:19444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789048775.055655:0:19444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789048775.055673:0:19444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08364a00/0x133f221c087772c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087772d0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048775.055685:0:19444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b08364a00/0x133f221c087772c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087772d0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789048775.055744:0:19444:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789048775.055746:0:19444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789048775.055748:0:19444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048775.055749:0:19444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048775.055750:0:19444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048775.055752:0:19444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048775.055753:0:19444:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789048775.055755:0:19444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048775.055756:0:19444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789048775.055761:0:19444:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789048775.055763:0:19444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789048775.055765:0:19444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789048775.055766:0:19444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048775.055767:0:19444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048775.055768:0:19444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048775.055769:0:19444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048775.055771:0:19444:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789048775.055772:0:19444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048775.055773:0:19444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789048775.055798:0:19444:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789048775.055819:0:19444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20220e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111472000:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789048775.055882:0:19444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048775.055928:0:19444:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c034fd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048775.056059:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111472000 00000100:00100000:1.0:1789048775.056066:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111472000 00000100:00100000:1.0:1789048775.056118:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789048775.056128:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:19444:x1875953111472000:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789048775.056156:0:17115:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789048775.056169:0:17115:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789048775.060271:0:17115:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789048775.060296:0:17115:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789048775.060666:0:17138:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789048775.060671:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789048775.060694:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff959c07060a00/0x133f221c08777301 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.060713:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959b07ba1a00/0x133f221c087771b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087771aa expref: 24 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.060721:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959b08364c00/0x133f221c087771bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087771b8 expref: 24 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.060728:0:17138:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959c07060a00/0x133f221c08777301 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.060766:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959b08364c00/0x133f221c087771bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c087771b8 expref: 24 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.060781:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959b08364c00/0x133f221c087771bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c087771b8 expref: 24 pid: 17116 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048775.060795:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1875953111472128:0@lo:104: 00000100:00100000:1.0:1789048775.060877:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789048775.060918:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959b07ba1a00/0x133f221c087771b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c087771aa expref: 24 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.060926:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959b07ba1a00/0x133f221c087771b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c087771aa expref: 24 pid: 17116 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048775.060935:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1875953111472256:0@lo:104: 00000100:00100000:1.0:1789048775.060958:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048775.060976:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c031d19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048775.060997:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111472128 00000100:00100000:1.0:1789048775.061004:0:17106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111472128 00000100:00100000:1.0:1789048775.061039:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111472256 00000100:00100000:1.0:1789048775.061042:0:17106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111472256 00000100:00100000:1.0:1789048775.061057:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789048775.061065:0:17106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+4:17138:x1875953111472128:12345-0@lo:104: 00010000:00010000:1.0:1789048775.061076:0:17106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c04cb1400/0x133f221c087771b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087771bf expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.061127:0:17106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789048775.061133:0:17106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+4:17138:x1875953111472128:12345-0@lo:104: Request processed in 69us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048775.061140:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789048775.061157:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789048775.061164:0:17106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+3:17138:x1875953111472256:12345-0@lo:104: 00010000:00010000:1.0:1789048775.061172:0:17106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087771aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087771b1 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.061207:0:17106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789048775.061219:0:17106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+3:17138:x1875953111472256:12345-0@lo:104: Request processed in 56us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048775.061225:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789048775.061242:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789048775.061249:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c04cb1400/0x133f221c087771b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087771bf expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.061255:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1400 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048775.061259:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c04cb1400/0x133f221c087771b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c087771bf expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.061268:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c04cb1400/0x133f221c087771b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c087771bf expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048775.061274:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c04cb1400/0x133f221c087771b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c087771bf expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048775.061280:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789048775.061307:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c04cb1400/0x133f221c087771b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087771bf expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.061314:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048775.061360:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c04cb1400/0x133f221c087771b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087771bf expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.061367:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c04cb1400/0x133f221c087771b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087771bf expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.061380:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048775.061383:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087771aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087771b1 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.061400:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08364800 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048775.061403:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087771aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c087771b1 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.061411:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087771aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c087771b1 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048775.061417:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087771aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c087771b1 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048775.061422:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789048775.061436:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087771aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087771b1 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.061442:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048775.061470:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087771aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087771b1 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.061477:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959b08364800/0x133f221c087771aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087771b1 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.061489:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048775.061491:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048775.061492:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048775.061498:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048775.061527:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111472384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789048775.061554:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048775.061748:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3622:1875953111472512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789048775.061784:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048775.062983:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:19444:x1875953111472000:12345-0@lo:253:mount.lustre.0 Request processed in 6853us (7096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048775.062996:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789048775.063070:0:19444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20220e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:19444:1875953111472000:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789048775.063085:0:19444:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789048775.063089:0:19444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789048775.063090:0:19444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789048775.063092:0:19444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048775.063093:0:19444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048775.063094:0:19444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048775.063095:0:19444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048775.063097:0:19444:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789048775.063099:0:19444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048775.063100:0:19444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789048775.063115:0:19444:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789048775.063894:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111472384 00000100:00100000:1.0:1789048775.063903:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111472384 00010000:00010000:1.0:1789048775.063931:0:17108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959b08364c00/0x133f221c087771bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087771b8 expref: 24 pid: 17116 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048775.063959:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111472512 00000100:00100000:1.0:1789048775.063962:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111472512 00010000:00010000:1.0:1789048775.063985:0:17108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959b07ba1a00/0x133f221c087771b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087771aa expref: 25 pid: 17116 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048775.064001:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789048775.064009:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+25:3621:x1875953111472384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789048775.064023:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048775.064028:0:17108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959b08364c00/0x133f221c087771bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087771b8 expref: 25 pid: 17116 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.064038:0:17108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959b08364c00/0x133f221c087771bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c087771b8 expref: 25 pid: 17116 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.064056:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048775.064110:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+25:3621:x1875953111472384:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (2554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048775.064116:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789048775.064132:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789048775.064139:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3622:x1875953111472512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789048775.064146:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048775.064150:0:17108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959b07ba1a00/0x133f221c087771b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087771aa expref: 24 pid: 17116 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.064170:0:17108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959b07ba1a00/0x133f221c087771b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c087771aa expref: 24 pid: 17116 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.064183:0:17108:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959c07060a00/0x133f221c08777301 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.064191:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c07060a00/0x133f221c08777301 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789048775.064207:0:17108:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008363484s 00010000:00010000:1.0:1789048775.064211:0:17108:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c07060a00/0x133f221c08777301 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.064218:0:17108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c07060a00/0x133f221c08777301 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.064225:0:17108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff959c07060a00/0x133f221c08777301 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.064231:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff959c07060a00/0x133f221c08777301 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.064237:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07060a00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048775.064242:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff959c07060a00/0x133f221c08777301 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.064250:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff959c07060a00/0x133f221c08777301 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.064259:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff959c07060a00/0x133f221c08777301 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.064275:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048775.064306:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3622:x1875953111472512:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (2521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048775.064313:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789048775.064453:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b08364c00/0x133f221c087771bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c087771b8 expref: 23 pid: 17116 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048775.064475:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1875953111472128:0@lo:104: 00010000:00010000:1.0:1789048775.064488:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b07ba1a00/0x133f221c087771b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c087771aa expref: 22 pid: 17116 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048775.064496:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1875953111472256:0@lo:104: 00010000:00010000:1.0:1789048775.064662:0:17138:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff959c07060a00/0x133f221c08777301 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.064673:0:17138:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff959c07060a00/0x133f221c08777301 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.064680:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff959c07060a00/0x133f221c08777301 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048775.064686:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c07060a00/0x133f221c08777301 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048775.064719:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3622:1875953111472512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789048775.064804:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111472384:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1789048775.067945:0:19444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789048775.073844:0:19444:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789048775.073865:0:19444:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789048775.073906:0:19444:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789048775.073948:0:19444:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789048775.073964:0:19444:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1789048775.073986:0:19444:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1789048775.075249:0:19444:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789048775.078987:0:19444:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789048775.139057:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111472640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048775.139145:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048775.139228:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111472640 00000100:00100000:1.0:1789048775.139238:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111472640 00000100:00100000:1.0:1789048775.139297:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789048775.139309:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111472640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789048775.139374:0:17127:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789048775.139433:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111472640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048775.139442:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789048775.139519:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111472640:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789048775.261538:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789048776.227705:0:17119:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789048776.227712:0:17119:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c08aff800 from 10 10000000:01000000:1.0:1789048776.227718:0:17119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789048776.227763:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777308 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048776.227785:0:17119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777308 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048776.227796:0:17119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777308 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048776.227836:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111472768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789048776.227921:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048776.227960:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b07659600 going to sleep for 11 seconds 00000100:00100000:1.0:1789048776.227979:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111472768 00000100:00100000:1.0:1789048776.227986:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111472768 00000100:00100000:1.0:1789048776.228049:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789048776.228059:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+22:17119:x1875953111472768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048776.228074:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048776.228086:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c07061e00/0x133f221c0877730f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777308 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048776.228110:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c07061e00/0x133f221c0877730f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777308 expref: 23 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048776.228122:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c07061e00/0x133f221c0877730f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777308 expref: 23 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048776.228131:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07061e00, rc 0) 00000100:00100000:1.0:1789048776.228168:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:17119:x1875953111472768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048776.228175:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789048776.228223:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111472768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048776.228238:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777308 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c0877730f expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048776.228246:0:17119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777308 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c0877730f expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048776.228300:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111472896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789048776.228354:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048776.228370:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b07659600 going to sleep for 11 seconds 00000100:00100000:1.0:1789048776.228383:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111472896 00000100:00100000:1.0:1789048776.228386:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111472896 00000100:00100000:1.0:1789048776.228408:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789048776.228414:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:17119:x1875953111472896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789048776.228426:0:17115:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789048776.228452:0:17115:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789048776.228456:0:17115:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1789048776.228532:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:17119:x1875953111472896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048776.228539:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789048776.228569:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111472896:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789048776.228619:0:17119:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789048776.228625:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777308 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c0877730f expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048776.228633:0:17119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c0877730f expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048776.228641:0:17119:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789048776.228643:0:17119:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c04ca4000 from 10 10000000:01000000:1.0:1789048776.228645:0:17119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789048776.228660:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048776.228676:0:17119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048776.228685:0:17119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048776.228698:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111473024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789048776.228723:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048776.228736:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b07659600 going to sleep for 11 seconds 00000100:00100000:1.0:1789048776.228747:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111473024 00000100:00100000:1.0:1789048776.228750:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111473024 00000100:00100000:1.0:1789048776.228772:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789048776.228778:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:17119:x1875953111473024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048776.228785:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048776.228793:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c07061600/0x133f221c0877731d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777316 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048776.228805:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c07061600/0x133f221c0877731d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777316 expref: 24 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048776.228813:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c07061600/0x133f221c0877731d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777316 expref: 24 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048776.228819:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07061600, rc 0) 00000100:00100000:1.0:1789048776.228844:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:17119:x1875953111473024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 67us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048776.228849:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789048776.228886:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111473024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048776.228896:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777316 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c0877731d expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048776.228903:0:17119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777316 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c0877731d expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048776.228940:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111473152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789048776.228967:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048776.228980:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b07659600 going to sleep for 11 seconds 00000100:00100000:1.0:1789048776.228991:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111473152 00000100:00100000:1.0:1789048776.228994:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111473152 00000100:00100000:1.0:1789048776.229014:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789048776.229020:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3291b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:17119:x1875953111473152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789048776.229029:0:17117:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789048776.229041:0:17117:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789048776.229044:0:17117:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1789048776.229105:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3291b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:17119:x1875953111473152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 85us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048776.229111:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789048776.229142:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111473152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789048776.229179:0:17119:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789048776.229185:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777316 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c0877731d expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048776.229193:0:17119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c0877731d expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048776.287836:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789048776.326139:0:19510:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789048776.327028:0:19510:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789048777.316851:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048777.705127:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111473280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789048777.705279:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048777.707719:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111473280 00000100:00100000:3.0:1789048777.707739:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111473280 00000100:00100000:3.0:1789048777.707911:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789048777.707925:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111473280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789048777.707971:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789048777.708104:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111473280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 183us (2825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048777.708113:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789048777.708267:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789048777.708324:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111473280:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789048778.339981:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048778.717751:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111473408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048778.717868:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048778.718519:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111473408 00000100:00100000:1.0:1789048778.718532:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111473408 00000100:00100000:1.0:1789048778.718659:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789048778.718673:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111473408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789048778.718710:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789048778.718780:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111473408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048778.718788:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789048778.718851:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111473408:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789048778.722680:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789048779.363829:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048779.741669:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789048779.741695:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111473536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789048779.741768:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048779.741837:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111473536 00000100:00100000:3.0:1789048779.741844:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111473536 00000100:00100000:3.0:1789048779.741885:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789048779.741894:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111473536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789048779.741925:0:17128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789048779.741966:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111473536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048779.741986:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789048779.742028:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111473536:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1789048780.253586:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789048780.253592:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789048780.253596:0:36:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789048780.253613:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff959c2ac8e800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048780.253635:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b07b10e00 x1875953111474048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789048780.253677:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789048780.253681:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789048780.253683:0:36:0:(import.c:65:import_set_state_nolock()) ffff959b0833b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789048780.253689:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff959b0833b800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048780.253703:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b07b11880 x1875953111474560/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048780.253754:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111473664:0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.253820:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048780.253866:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111474304:0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.253890:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048780.253909:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111474944:0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.253927:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048780.253949:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789048780.253954:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111474176:0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.253970:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048780.253996:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875953111474816:0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.254016:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048780.254039:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111473792:0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.254058:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048780.254073:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111474432:0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.254098:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048780.254114:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111475072:0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.254136:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048780.254152:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789048780.254157:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111473920:0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.254174:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048780.254189:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111474688:0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.254207:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048780.254217:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111475200:0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.254234:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048780.254251:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111474048:0@lo:8:kworker.0 00000100:00100000:3.0:1789048780.254287:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048780.254306:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111474560:0@lo:8:kworker.0 00000100:00100000:3.0:1789048780.254325:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048780.254381:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111474304 00000100:00100000:3.0:1789048780.254388:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111474304 00000100:00100000:3.0:1789048780.254437:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111473792 00000100:00100000:3.0:1789048780.254441:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111473792 00000100:00100000:3.0:1789048780.254458:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789048780.254467:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111474304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.254533:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111474304:12345-0@lo:400:kworker.0 Request processed in 67us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048780.254541:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789048780.254569:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789048780.254575:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111473792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.254606:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111473792:12345-0@lo:400:kworker.0 Request processed in 31us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048780.254612:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789048780.254629:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111474432 00000100:00100000:3.0:1789048780.254632:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111474432 00000100:00100000:3.0:1789048780.254660:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111473920 00000100:00100000:3.0:1789048780.254663:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111473920 00000100:00100000:3.0:1789048780.254674:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111474048 00000100:00100000:3.0:1789048780.254676:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111474048 00000100:00100000:3.0:1789048780.254685:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111474560 00000100:00100000:3.0:1789048780.254688:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111474560 00000100:00100000:3.0:1789048780.254698:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789048780.254704:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08925f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111474432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.254737:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08925f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111474432:12345-0@lo:400:kworker.0 Request processed in 33us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048780.254743:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789048780.254755:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789048780.254761:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111473920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.254788:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111473920:12345-0@lo:400:kworker.0 Request processed in 27us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048780.254793:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789048780.254805:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789048780.254817:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3619:x1875953111474048:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789048780.254844:0:18631:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:3.0:1789048780.254876:0:18631:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x133f221c08777324 00002000:00100000:3.0:1789048780.254891:0:18631:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff959c05303000 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789048780.254895:0:18631:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789048780.254899:0:18631:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789048780.255096:0:18631:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789048780.255120:0:18631:0:(import.c:65:import_set_state_nolock()) ffff959c05307000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789048780.255156:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1875953111474048:12345-0@lo:8:kworker.0 Request processed in 338us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048780.255163:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789048780.255176:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789048780.255181:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3619:x1875953111474560:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789048780.255194:0:18631:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:3.0:1789048780.255210:0:18631:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x133f221c0877732b 00002000:00100000:3.0:1789048780.255215:0:18631:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff959c05306000 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789048780.255218:0:18631:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1789048780.255220:0:18631:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789048780.255240:0:18631:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789048780.255253:0:18631:0:(import.c:65:import_set_state_nolock()) ffff959b076eb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789048780.255278:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3619:x1875953111474560:12345-0@lo:8:kworker.0 Request processed in 95us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048780.255284:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789048780.255306:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111474944 00000100:00100000:3.0:1789048780.255309:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111474944 00000100:00100000:3.0:1789048780.255329:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111474176 00000100:00100000:3.0:1789048780.255363:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111474176 00000100:00100000:3.0:1789048780.255377:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111474816 00000100:00100000:3.0:1789048780.255379:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111474816 00000100:00100000:3.0:1789048780.255392:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111475072 00000100:00100000:3.0:1789048780.255395:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111475072 00000100:00100000:3.0:1789048780.255422:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111474688 00000100:00100000:3.0:1789048780.255425:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111474688 00000100:00100000:3.0:1789048780.255436:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111475200 00000100:00100000:3.0:1789048780.255438:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111475200 00000100:00100000:3.0:1789048780.255452:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789048780.255458:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111474944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.255486:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111474944:12345-0@lo:400:kworker.0 Request processed in 29us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048780.255492:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789048780.255503:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789048780.255508:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111474176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.255528:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111474176:12345-0@lo:400:kworker.0 Request processed in 20us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048780.255532:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789048780.255541:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789048780.255547:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875953111474816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.255570:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875953111474816:12345-0@lo:400:kworker.0 Request processed in 24us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048780.255576:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789048780.255586:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789048780.255591:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111475072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.255616:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111475072:12345-0@lo:400:kworker.0 Request processed in 25us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048780.255631:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789048780.255642:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789048780.255647:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111474688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.255672:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111474688:12345-0@lo:400:kworker.0 Request processed in 26us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048780.255678:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789048780.255688:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789048780.255694:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111475200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.255717:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111475200:12345-0@lo:400:kworker.0 Request processed in 24us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048780.255722:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1789048780.255746:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048780.255749:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789048780.255751:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789048780.255778:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07b10e00 x1875953111474048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789048805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789048780.255794:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789048780.255802:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:3.0:1789048780.255807:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789048780.255810:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789048780.255834:0:3619:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789048780.255839:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111474048:0@lo:8:kworker.0 00010000:00080000:3.0:1789048780.255853:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07b11880 x1875953111474560/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789048805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789048780.255862:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789048780.255874:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:3.0:1789048780.255877:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789048780.255879:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b0833b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789048780.255890:0:3619:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789048780.255893:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111474560:0@lo:8:kworker.0 00000100:00100000:3.0:1789048780.255933:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111473920:0@lo:400:kworker.0 00010000:00080000:3.0:1789048780.255944:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07b13480 x1875953111474688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048780.255953:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111474688:0@lo:400:kworker.0 00010000:00080000:3.0:1789048780.255963:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08845180 x1875953111475200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048780.255970:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111475200:0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.255980:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111473792:0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.255990:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111474432:0@lo:400:kworker.0 00010000:00080000:3.0:1789048780.255998:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07b10a80 x1875953111475072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048780.256006:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111475072:0@lo:400:kworker.0 00010000:00080000:3.0:1789048780.256044:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07b13100 x1875953111474176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048780.256053:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111474176:0@lo:400:kworker.0 00010000:00080000:3.0:1789048780.256062:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07b12680 x1875953111474816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048780.256082:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875953111474816:0@lo:400:kworker.0 00000100:00100000:3.0:1789048780.256096:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111474304:0@lo:400:kworker.0 00010000:00080000:3.0:1789048780.256106:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b07b12d80 x1875953111474944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048780.256113:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111474944:0@lo:400:kworker.0 00000100:00100000:0.0:1789048780.256785:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111473664 00000100:00100000:0.0:1789048780.256793:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111473664 00000100:00100000:0.0:1789048780.256835:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789048780.256842:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32918c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3623:x1875953111473664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048780.256903:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32918c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3623:x1875953111473664:12345-0@lo:400:kworker.0 Request processed in 62us (3083us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048780.256909:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789048780.257564:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111475328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789048780.257613:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789048780.257662:0:17149:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1789048780.257694:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20220000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17149:1875953111475456:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789048780.257726:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048780.257743:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c37fc0a80 going to sleep for 11 seconds 00000004:00080000:2.0:1789048780.257761:0:17866:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789048780.257850:0:17866:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 535011516312ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789048780.257863:0:17866:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1789048780.258908:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111475456 00000100:00100000:1.0:1789048780.258920:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111475456 00000100:00100000:1.0:1789048780.258980:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789048780.258989:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17149:x1875953111475456:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789048780.259077:0:17856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:1.0:1789048780.259186:0:17148:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789048780.259247:0:17148:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 535012912895ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789048780.259253:0:17148:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1789048780.259958:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111475584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048780.260014:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048780.260060:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111473664:0@lo:400:kworker.0 00000100:00080000:3.0:1789048780.260522:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789048780.263501:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111475328 00000100:00100000:0.0:1789048780.263516:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111475328 00000100:00100000:0.0:1789048780.263567:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111475584 00000100:00100000:0.0:1789048780.263570:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111475584 00000100:00100000:0.0:1789048780.263608:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789048780.263617:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3622:x1875953111475328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789048780.263658:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789048780.263819:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3622:x1875953111475328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 203us (6206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048780.263827:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789048780.263843:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789048780.263850:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1875953111475584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789048780.263859:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789048780.263889:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1875953111475584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (3874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048780.263895:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789048780.263963:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789048780.263976:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111475712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048780.264017:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789048780.264048:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789048780.264060:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111475712 00000100:00100000:0.0:1789048780.264064:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111475712 00000100:00100000:0.0:1789048780.264089:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789048780.264097:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111475712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789048780.264783:0:17128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789048780.264830:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111475712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 735us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048780.264842:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789048780.264885:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111475712:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1789048780.264921:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fcd1880 x1875953111475584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048780.264935:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111475584:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1789048780.264977:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c20222a00 x1875953111475328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048780.264990:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111475328:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1789048780.271932:0:17867:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789048780.271991:0:17867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17867:1875953111475840:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1789048780.272061:0:17867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048780.272091:0:17867:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c07a21300 going to sleep for 11 seconds 00000100:00100000:1.0:1789048780.272120:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111475840 00000100:00100000:1.0:1789048780.272138:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111475840 00000100:00100000:1.0:1789048780.272188:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789048780.272197:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17867:x1875953111475840:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1789048780.276025:0:17102:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1789048780.278670:0:18632:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1789048780.278683:0:18632:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1789048780.278690:0:18632:0:(ofd_dev.c:1497:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00080000:1.0:1789048780.285239:0:18912:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789048780.285251:0:18912:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789048780.285360:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17867:x1875953111475840:12345-0@lo:7:osp-pre-1-1.0 Request processed in 13160us (13294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048780.285372:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1789048780.285445:0:17867:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fcd1c00 x1875953111475840/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789048796 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048780.285462:0:17867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17867:1875953111475840:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789048780.285475:0:17867:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789048780.285518:0:17867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17867:1875953111475968:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789048780.288612:0:17867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048780.288661:0:17867:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c07a21300 going to sleep for 11 seconds 00000100:00100000:1.0:1789048780.288693:0:18630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111475968 00000100:00100000:1.0:1789048780.288703:0:18630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111475968 00000100:00100000:1.0:1789048780.288756:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789048780.288765:0:18630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17867:x1875953111475968:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789048780.288799:0:18630:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1789048780.288859:0:18630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17867:x1875953111475968:12345-0@lo:5:osp-pre-1-1.0 Request processed in 94us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048780.288866:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1789048780.288907:0:17867:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fcd1c00 x1875953111475968/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789048796 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048780.288921:0:17867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17867:1875953111475968:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789048780.288950:0:17867:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789048780.288995:0:17867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17867:1875953111476096:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789048780.289025:0:17867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048780.289039:0:17867:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c07a21300 going to sleep for 11 seconds 00000100:00100000:1.0:1789048780.289051:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111476096 00000100:00100000:1.0:1789048780.289056:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111476096 00000100:00100000:1.0:1789048780.289077:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789048780.289082:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17867:x1875953111476096:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789048780.289108:0:18912:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:3.0:1789048780.310213:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048780.310226:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df3894d9/0x133f221c08777332 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048780.310241:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1789048780.310246:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048780.310252:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df3894d9/0x133f221c08777332 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048780.310271:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df3894d9/0x133f221c08777332 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048780.310291:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df3894d9/0x133f221c08777332 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048780.310298:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df3894d9/0x133f221c08777332 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048780.310315:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789048780.310326:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048780.310345:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df3894d9/0x133f221c08777332 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048780.310353:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c000 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048780.310357:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df3894d9/0x133f221c08777332 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048780.310366:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df3894d9/0x133f221c08777332 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048780.310381:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df3894d9/0x133f221c08777332 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048780.310389:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df3894d9/0x133f221c08777332 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048780.310416:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048780.310424:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048780.310426:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048780.311857:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048780.311870:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038ee4368/0x133f221c08777339 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048780.311886:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1789048780.311891:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048780.311897:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038ee4368/0x133f221c08777339 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048780.311909:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038ee4368/0x133f221c08777339 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048780.311929:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038ee4368/0x133f221c08777339 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048780.311937:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038ee4368/0x133f221c08777339 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048780.312013:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789048780.319467:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048780.319480:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000124ac425/0x133f221c08777340 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.319496:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789048780.319502:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048780.319508:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000124ac425/0x133f221c08777340 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.319524:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000124ac425/0x133f221c08777340 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.319535:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000124ac425/0x133f221c08777340 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.319543:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000124ac425/0x133f221c08777340 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.319887:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789048780.319897:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038ee4368/0x133f221c08777339 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.319906:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3ce00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048780.319911:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038ee4368/0x133f221c08777339 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.319934:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038ee4368/0x133f221c08777339 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.319958:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038ee4368/0x133f221c08777339 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.319966:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038ee4368/0x133f221c08777339 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.319987:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048780.319991:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000124ac425/0x133f221c08777340 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.319997:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07060a00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048780.320000:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000124ac425/0x133f221c08777340 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.320020:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000124ac425/0x133f221c08777340 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.320030:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000124ac425/0x133f221c08777340 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.320038:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048780.320040:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048780.320042:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.329803:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789048780.329818:0:18632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000124ac425/0x133f221c08777340 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.329872:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789048780.337004:0:19445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1789048780.337021:0:19445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789048780.337025:0:19445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789048780.337241:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17867:x1875953111476096:12345-0@lo:5:osp-pre-1-1.0 Request processed in 48152us (48209us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789048780.337251:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789048780.337362:0:17867:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789048780.337370:0:17867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17867:1875953111476096:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789048780.337385:0:17867:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1789048780.337444:0:17867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20221f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17867:1875953111476224:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789048780.337485:0:17867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048780.337508:0:17867:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c37fc03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048780.337607:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111476224 00000100:00100000:3.0:1789048780.337614:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111476224 00000100:00100000:3.0:1789048780.337655:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789048780.337663:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17867:x1875953111476224:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789048780.337726:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17867:x1875953111476224:12345-0@lo:900:osp-pre-1-1.0 Request processed in 64us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048780.337733:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789048780.337759:0:17867:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c20221f80 x1875953111476224/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789048796 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048780.337770:0:17867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20221f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17867:1875953111476224:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1789048780.338308:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048780.338317:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fd77317/0x133f221c08777347 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.338390:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789048780.338395:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048780.338430:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fd77317/0x133f221c08777347 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.338445:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fd77317/0x133f221c08777347 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.338505:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fd77317/0x133f221c08777347 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.338514:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fd77317/0x133f221c08777347 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.338570:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789048780.339015:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048780.339025:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbb4b488/0x133f221c0877734e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.339035:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1789048780.339039:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048780.339043:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbb4b488/0x133f221c0877734e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.339053:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbb4b488/0x133f221c0877734e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.339061:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbb4b488/0x133f221c0877734e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.339068:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbb4b488/0x133f221c0877734e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.342633:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789048780.342647:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fd77317/0x133f221c08777347 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.342887:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07061200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048780.342893:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd77317/0x133f221c08777347 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.342916:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd77317/0x133f221c08777347 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.342938:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fd77317/0x133f221c08777347 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.342945:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fd77317/0x133f221c08777347 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048780.343648:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048780.343655:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbb4b488/0x133f221c0877734e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048780.343663:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07061800 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048780.343679:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbb4b488/0x133f221c0877734e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048780.343688:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbb4b488/0x133f221c0877734e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048780.343701:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbb4b488/0x133f221c0877734e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048780.343711:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048780.343713:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048780.343716:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048780.344718:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.344720:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789048780.344729:0:18632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbb4b488/0x133f221c0877734e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789048780.345715:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048780.345726:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002be18a2f/0x133f221c08777355 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.345751:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1789048780.345756:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048780.345763:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002be18a2f/0x133f221c08777355 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.345779:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002be18a2f/0x133f221c08777355 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.345790:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002be18a2f/0x133f221c08777355 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.345813:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002be18a2f/0x133f221c08777355 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.345838:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789048780.345878:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048780.345885:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002be18a2f/0x133f221c08777355 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.345893:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08364c00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048780.345898:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002be18a2f/0x133f221c08777355 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.345912:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002be18a2f/0x133f221c08777355 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.345928:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002be18a2f/0x133f221c08777355 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.345935:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002be18a2f/0x133f221c08777355 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.345951:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.345953:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.345955:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048780.350834:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048780.350848:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077473f66/0x133f221c0877735c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.350866:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1789048780.350870:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048780.350876:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077473f66/0x133f221c0877735c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.350892:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077473f66/0x133f221c0877735c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.350904:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077473f66/0x133f221c0877735c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.350913:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077473f66/0x133f221c0877735c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.351840:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048780.352598:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048780.352608:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077473f66/0x133f221c0877735c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.352619:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08364800 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048780.352623:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077473f66/0x133f221c0877735c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.352634:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077473f66/0x133f221c0877735c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.352652:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077473f66/0x133f221c0877735c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.352659:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077473f66/0x133f221c0877735c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.352708:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048780.352710:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048780.352712:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048780.354036:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048780.354049:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcfae94a/0x133f221c08777363 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.354076:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1789048780.354080:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048780.354086:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcfae94a/0x133f221c08777363 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.354173:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcfae94a/0x133f221c08777363 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.354184:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcfae94a/0x133f221c08777363 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.354191:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcfae94a/0x133f221c08777363 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.354216:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789048780.355563:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048780.355574:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcfae94a/0x133f221c08777363 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.355586:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08365c00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048780.355591:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcfae94a/0x133f221c08777363 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.355601:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcfae94a/0x133f221c08777363 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.355621:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcfae94a/0x133f221c08777363 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.355640:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcfae94a/0x133f221c08777363 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.355657:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.355659:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.355660:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048780.356653:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048780.356665:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002be18a2f/0x133f221c0877736a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.356682:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1789048780.356687:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048780.356694:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002be18a2f/0x133f221c0877736a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.356710:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002be18a2f/0x133f221c0877736a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.356810:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002be18a2f/0x133f221c0877736a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.356820:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002be18a2f/0x133f221c0877736a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.356849:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789048780.356880:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048780.356886:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002be18a2f/0x133f221c0877736a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.356894:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08364c00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048780.356897:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002be18a2f/0x133f221c0877736a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.356904:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002be18a2f/0x133f221c0877736a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.356918:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002be18a2f/0x133f221c0877736a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.356925:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002be18a2f/0x133f221c0877736a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.356942:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.356944:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.356946:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048780.360968:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048780.360983:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd9f89da/0x133f221c08777371 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.361001:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1789048780.361005:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048780.361011:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd9f89da/0x133f221c08777371 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.361025:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd9f89da/0x133f221c08777371 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.361035:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd9f89da/0x133f221c08777371 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.361043:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd9f89da/0x133f221c08777371 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.361081:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789048780.361288:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048780.361296:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd9f89da/0x133f221c08777371 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.361304:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c420cc200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048780.361309:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd9f89da/0x133f221c08777371 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.361318:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd9f89da/0x133f221c08777371 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.361366:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd9f89da/0x133f221c08777371 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.361375:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd9f89da/0x133f221c08777371 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.361396:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.361398:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.361399:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048780.362618:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048780.362629:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c457548/0x133f221c08777378 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.362643:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1789048780.362647:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048780.362653:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c457548/0x133f221c08777378 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.362665:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c457548/0x133f221c08777378 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.362674:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c457548/0x133f221c08777378 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.362682:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c457548/0x133f221c08777378 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.362705:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789048780.362752:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048780.362758:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c457548/0x133f221c08777378 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.362765:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c420cd200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048780.362768:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c457548/0x133f221c08777378 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.362787:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c457548/0x133f221c08777378 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.362802:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c457548/0x133f221c08777378 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.362809:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c457548/0x133f221c08777378 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.362825:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.362827:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.362829:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048780.363030:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048780.363036:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000541045d6/0x133f221c0877737f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.363045:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1789048780.363053:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048780.363058:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000541045d6/0x133f221c0877737f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.363068:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000541045d6/0x133f221c0877737f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.363075:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000541045d6/0x133f221c0877737f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.363081:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000541045d6/0x133f221c0877737f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.363099:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789048780.363316:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048780.363321:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000541045d6/0x133f221c0877737f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.363329:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c420cd000 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048780.363355:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000541045d6/0x133f221c0877737f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.363363:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000541045d6/0x133f221c0877737f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.363375:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000541045d6/0x133f221c0877737f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.363393:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000541045d6/0x133f221c0877737f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.363418:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.363420:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.363422:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048780.363515:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048780.363520:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059a7c38c/0x133f221c08777386 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.363529:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1789048780.363532:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048780.363536:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059a7c38c/0x133f221c08777386 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.363545:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059a7c38c/0x133f221c08777386 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.363553:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059a7c38c/0x133f221c08777386 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.363565:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059a7c38c/0x133f221c08777386 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.363586:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789048780.363906:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048780.363912:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059a7c38c/0x133f221c08777386 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.363921:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c420cda00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048780.363924:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059a7c38c/0x133f221c08777386 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.363932:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059a7c38c/0x133f221c08777386 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.363944:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059a7c38c/0x133f221c08777386 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.363950:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059a7c38c/0x133f221c08777386 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.363965:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.363967:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.363968:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048780.364487:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048780.364495:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a81bc47/0x133f221c0877738d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.364506:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1789048780.364509:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048780.364514:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a81bc47/0x133f221c0877738d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.364524:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a81bc47/0x133f221c0877738d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.364531:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a81bc47/0x133f221c0877738d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.364539:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a81bc47/0x133f221c0877738d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.364556:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789048780.364902:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048780.364908:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a81bc47/0x133f221c0877738d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.364915:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c420cca00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048780.364919:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a81bc47/0x133f221c0877738d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.364928:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a81bc47/0x133f221c0877738d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.364941:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a81bc47/0x133f221c0877738d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.364947:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a81bc47/0x133f221c0877738d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.364965:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.364967:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.364968:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048780.365052:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048780.365058:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e8db0ed/0x133f221c08777394 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.365072:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1789048780.365075:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048780.365079:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e8db0ed/0x133f221c08777394 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.365088:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e8db0ed/0x133f221c08777394 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.365096:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e8db0ed/0x133f221c08777394 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.365104:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e8db0ed/0x133f221c08777394 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.366467:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789048780.370459:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048780.370474:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe10a1b3/0x133f221c0877739b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.370492:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1789048780.370497:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048780.370504:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe10a1b3/0x133f221c0877739b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.370519:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe10a1b3/0x133f221c0877739b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.370544:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe10a1b3/0x133f221c0877739b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.370552:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe10a1b3/0x133f221c0877739b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.374764:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789048780.374778:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e8db0ed/0x133f221c08777394 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.374791:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c420cc000 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048780.374796:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e8db0ed/0x133f221c08777394 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.374819:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e8db0ed/0x133f221c08777394 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.374839:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e8db0ed/0x133f221c08777394 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.374847:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e8db0ed/0x133f221c08777394 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.374866:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048780.374870:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe10a1b3/0x133f221c0877739b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.374876:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38400 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048780.374879:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe10a1b3/0x133f221c0877739b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.374887:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe10a1b3/0x133f221c0877739b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.374897:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe10a1b3/0x133f221c0877739b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.374904:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.374906:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.374912:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048780.377810:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789048780.377826:0:18632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe10a1b3/0x133f221c0877739b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.378220:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048780.378877:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048780.378885:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002206f60d/0x133f221c087773a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.378901:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1789048780.378906:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048780.378913:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002206f60d/0x133f221c087773a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.378927:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002206f60d/0x133f221c087773a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.378937:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002206f60d/0x133f221c087773a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.378958:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002206f60d/0x133f221c087773a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.378972:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789048780.379263:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048780.379271:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002206f60d/0x133f221c087773a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.379279:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39400 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048780.379283:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002206f60d/0x133f221c087773a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.379292:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002206f60d/0x133f221c087773a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.379307:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002206f60d/0x133f221c087773a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.379314:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002206f60d/0x133f221c087773a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.379330:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.379352:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.379354:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048780.381690:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048780.381703:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000900ebc76/0x133f221c087773a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.381720:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1789048780.381725:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048780.381731:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000900ebc76/0x133f221c087773a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.381745:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000900ebc76/0x133f221c087773a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.381754:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000900ebc76/0x133f221c087773a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.381760:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000900ebc76/0x133f221c087773a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.381783:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789048780.382779:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048780.382788:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000900ebc76/0x133f221c087773a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.382798:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38c00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048780.382802:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000900ebc76/0x133f221c087773a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.382819:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000900ebc76/0x133f221c087773a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.382836:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000900ebc76/0x133f221c087773a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.382844:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000900ebc76/0x133f221c087773a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.382865:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.382867:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.382869:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048780.383817:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048780.383880:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048780.383896:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3a68e6c/0x133f221c087773b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.383910:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1789048780.383914:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048780.383919:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3a68e6c/0x133f221c087773b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.383932:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3a68e6c/0x133f221c087773b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.383941:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3a68e6c/0x133f221c087773b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.383948:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3a68e6c/0x133f221c087773b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.383963:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789048780.385718:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789048780.385731:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c087773b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.385747:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1789048780.385751:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048780.385756:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c087773b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.385769:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c087773b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.385778:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c087773b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.385786:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c087773b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.385808:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789048780.386220:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789048780.386228:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3a68e6c/0x133f221c087773b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.386236:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39c00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048780.386240:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3a68e6c/0x133f221c087773b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.386250:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3a68e6c/0x133f221c087773b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.386275:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3a68e6c/0x133f221c087773b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.386283:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3a68e6c/0x133f221c087773b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.386302:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048780.386306:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c087773b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.386312:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048780.386316:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c087773b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.386324:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c087773b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.386363:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c087773b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.386371:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002997e870/0x133f221c087773b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.386384:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048780.386386:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048780.386392:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789048780.386597:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789048780.386604:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000184977c7/0x133f221c087773be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.386623:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1789048780.386626:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048780.386630:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000184977c7/0x133f221c087773be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.386639:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000184977c7/0x133f221c087773be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.386647:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000184977c7/0x133f221c087773be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.386655:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000184977c7/0x133f221c087773be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.386678:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789048780.387009:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789048780.387015:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a78c6cd4/0x133f221c087773c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.387024:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1789048780.387028:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048780.387031:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a78c6cd4/0x133f221c087773c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.387041:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a78c6cd4/0x133f221c087773c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.387061:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a78c6cd4/0x133f221c087773c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.387069:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a78c6cd4/0x133f221c087773c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.387078:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789048780.387289:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789048780.387297:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000184977c7/0x133f221c087773be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.387305:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1400 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048780.387308:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000184977c7/0x133f221c087773be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.387316:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000184977c7/0x133f221c087773be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.387329:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000184977c7/0x133f221c087773be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.387372:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000184977c7/0x133f221c087773be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.387388:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048780.387391:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a78c6cd4/0x133f221c087773c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.387398:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048780.387401:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a78c6cd4/0x133f221c087773c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.387421:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a78c6cd4/0x133f221c087773c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.387431:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a78c6cd4/0x133f221c087773c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.387438:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a78c6cd4/0x133f221c087773c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048780.387450:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789048780.387573:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789048780.387578:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d1729ee/0x133f221c087773cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.387586:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1789048780.387590:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048780.387594:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d1729ee/0x133f221c087773cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.387604:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d1729ee/0x133f221c087773cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.387612:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d1729ee/0x133f221c087773cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.387619:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d1729ee/0x133f221c087773cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.387638:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789048780.387788:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048780.387794:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d1729ee/0x133f221c087773cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.387801:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048780.387804:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d1729ee/0x133f221c087773cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.387812:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d1729ee/0x133f221c087773cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.387823:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d1729ee/0x133f221c087773cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.387830:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d1729ee/0x133f221c087773cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.387845:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048780.387846:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048780.387848:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.387879:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048780.387881:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789048780.388851:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789048780.388859:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037d25607/0x133f221c087773d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.388872:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1789048780.388876:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048780.388881:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037d25607/0x133f221c087773d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.388891:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037d25607/0x133f221c087773d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.388899:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037d25607/0x133f221c087773d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.388908:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037d25607/0x133f221c087773d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.388927:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789048780.389181:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048780.389187:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037d25607/0x133f221c087773d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.389194:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1e00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048780.389198:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037d25607/0x133f221c087773d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.389218:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037d25607/0x133f221c087773d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.389232:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037d25607/0x133f221c087773d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.389239:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037d25607/0x133f221c087773d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.389254:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048780.389256:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048780.389258:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789048780.390625:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789048780.390635:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcfae94a/0x133f221c087773da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.390650:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1789048780.390661:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048780.390817:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcfae94a/0x133f221c087773da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.390830:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcfae94a/0x133f221c087773da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.390839:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcfae94a/0x133f221c087773da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.390846:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcfae94a/0x133f221c087773da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.390871:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789048780.391926:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048780.391935:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcfae94a/0x133f221c087773da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.391947:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08365c00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048780.391952:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcfae94a/0x133f221c087773da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.391962:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcfae94a/0x133f221c087773da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.391981:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcfae94a/0x133f221c087773da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.392002:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcfae94a/0x133f221c087773da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.392022:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048780.392024:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048780.392025:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789048780.392198:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789048780.392205:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077473f66/0x133f221c087773e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.392215:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1789048780.392219:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048780.392223:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077473f66/0x133f221c087773e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.392233:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077473f66/0x133f221c087773e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.392241:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077473f66/0x133f221c087773e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.392254:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077473f66/0x133f221c087773e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.392280:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789048780.392893:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789048780.392900:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068da57f1/0x133f221c087773e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.392910:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1789048780.392913:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048780.392918:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068da57f1/0x133f221c087773e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.392926:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068da57f1/0x133f221c087773e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.392934:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068da57f1/0x133f221c087773e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.392941:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068da57f1/0x133f221c087773e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.392955:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789048780.394847:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789048780.394860:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077473f66/0x133f221c087773e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.394874:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08364800 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048780.394879:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077473f66/0x133f221c087773e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.394890:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077473f66/0x133f221c087773e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.394909:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077473f66/0x133f221c087773e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.394917:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077473f66/0x133f221c087773e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.394937:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048780.394941:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068da57f1/0x133f221c087773e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.394955:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1a00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048780.394958:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068da57f1/0x133f221c087773e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.394966:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068da57f1/0x133f221c087773e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.394976:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068da57f1/0x133f221c087773e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.394984:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068da57f1/0x133f221c087773e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.394997:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048780.394999:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048780.395001:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048780.395008:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789048780.396557:0:18632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789048780.396570:0:18632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ccd2448/0x133f221c087773ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.396593:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1789048780.396598:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048780.396603:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ccd2448/0x133f221c087773ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.396617:0:18632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ccd2448/0x133f221c087773ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.396626:0:18632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ccd2448/0x133f221c087773ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.396634:0:18632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ccd2448/0x133f221c087773ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048780.396652:0:18632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789048780.396747:0:18632:0:(ofd_dev.c:1524:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:2.0:1789048780.396846:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17149:x1875953111475456:12345-0@lo:5:osp-pre-1-0.0 Request processed in 137855us (139114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048780.396855:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789048780.396913:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20220000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17149:1875953111475456:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789048780.396930:0:17149:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1789048780.396978:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20220000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17149:1875953111476352:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789048780.397012:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048780.397042:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c1142d840 going to sleep for 11 seconds 00000100:00100000:2.0:1789048780.397067:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111476352 00000100:00100000:2.0:1789048780.397073:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111476352 00000100:00100000:2.0:1789048780.397114:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789048780.397123:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17149:x1875953111476352:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789048780.397158:0:18632:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:0.0:1789048780.397363:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048780.397370:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ccd2448/0x133f221c087773ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.397379:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048780.397383:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ccd2448/0x133f221c087773ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.397393:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ccd2448/0x133f221c087773ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.397429:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ccd2448/0x133f221c087773ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.397437:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ccd2448/0x133f221c087773ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048780.397455:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048780.397457:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048780.397459:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048780.405794:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17149:x1875953111476352:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8664us (8773us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789048780.405809:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789048780.407606:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20220000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17149:1875953111476352:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789048780.407628:0:17149:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:2.0:1789048781.406034:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789048781.987962:0:17877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1789048782.399262:0:19800:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789048782.430666:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048782.813589:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789048782.813632:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111476480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048782.813700:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048782.813844:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111476480 00000100:00100000:2.0:1789048782.813852:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111476480 00000100:00100000:2.0:1789048782.813917:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789048782.813927:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111476480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789048782.813962:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789048782.814011:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111476480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048782.814027:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789048782.814078:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111476480:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789048782.815363:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:3.0:1789048783.448314:0:19852:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789048783.450005:0:19852:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789048783.454677:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048783.837814:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789048783.837837:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111476608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789048783.837922:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048783.837996:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111476608 00000100:00100000:1.0:1789048783.838004:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111476608 00000100:00100000:1.0:1789048783.838058:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789048783.838067:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111476608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789048783.838089:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789048783.838133:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111476608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048783.838140:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789048783.838161:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789048783.838199:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111476608:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789048784.491399:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789048784.620313:0:19902:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789048784.621169:0:19902:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789048784.862900:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111476736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048784.862973:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789048784.863405:0:17157:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789048784.863706:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111476736 00000100:00100000:3.0:1789048784.863715:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111476736 00000100:00100000:3.0:1789048784.863771:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789048784.863780:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111476736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789048784.863815:0:17127:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789048784.863876:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111476736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048784.863884:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789048784.864056:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111476736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048784.985316:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048784.985457:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097756544 00000100:00100000:2.0:1789048784.985467:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097756544 00000100:00100000:2.0:1789048784.985510:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 117 00000100:00100000:2.0:1789048784.985518:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3291ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2390:x1875953097756544:12345-192.168.202.16@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789048784.985547:0:17116:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 5d991937-03b3-45a3-961b-b41aa0369386@192.168.202.16@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:2.0:1789048784.985595:0:17116:0:(genops.c:1384:class_connect()) connect: client 5d991937-03b3-45a3-961b-b41aa0369386, cookie 0x133f221c087773f6 00000100:00080000:2.0:1789048784.985729:0:17116:0:(import.c:65:import_set_state_nolock()) ffff959b0693c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789048784.985803:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3291ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+5:2390:x1875953097756544:12345-192.168.202.16@tcp:250:mount.lustre.0 Request processed in 284us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048784.985811:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 117 00000100:00100000:1.0:1789048784.989144:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048784.989255:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097756672 00000100:00100000:0.0:1789048784.989272:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097756672 00000100:00100000:0.0:1789048784.989576:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:0.0:1789048784.989586:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32919050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+5:14888:x1875953097756672:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789048784.989603:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048784.989625:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef38200/0x133f221c087773fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29ac1 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048784.989655:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef38200/0x133f221c087773fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29ac1 expref: 6 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048784.989668:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef38200/0x133f221c087773fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29ac1 expref: 6 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048784.989693:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38200, rc 0) 00000100:00100000:0.0:1789048784.989742:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32919050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+6:14888:x1875953097756672:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 157us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048784.989749:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:3.0:1789048784.992854:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048784.994445:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097756800 00000100:00100000:0.0:1789048784.994458:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097756800 00000100:00100000:0.0:1789048784.994531:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 119 00000100:00100000:0.0:1789048784.994541:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+6:14888:x1875953097756800:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789048784.994669:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+6:14888:x1875953097756800:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 129us (1824us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789048784.994678:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 119 00000100:00100000:1.0:1789048785.011269:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048785.011385:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097756928 00000100:00100000:2.0:1789048785.011396:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097756928 00000100:00100000:2.0:1789048785.011461:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 120 00000100:00100000:2.0:1789048785.011472:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3291bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+6:14888:x1875953097756928:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789048785.011488:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048785.011507:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba1400/0x133f221c08777404 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29ac8 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048785.011535:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba1400/0x133f221c08777404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29ac8 expref: 7 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048785.011545:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba1400/0x133f221c08777404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29ac8 expref: 7 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048785.011553:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1400, rc 0) 00000100:00100000:2.0:1789048785.011610:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3291bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+7:14888:x1875953097756928:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 140us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048785.011617:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 120 00000100:00100000:2.0:1789048785.015542:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048785.024745:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097757056 00000100:00100000:1.0:1789048785.024761:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097757056 00000100:00100000:1.0:1789048785.024904:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 121 00000100:00100000:1.0:1789048785.024915:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32918450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+7:14888:x1875953097757056:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789048785.025093:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32918450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+8:14888:x1875953097757056:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 180us (9559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048785.025102:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 121 00000100:00100000:0.0:1789048785.038476:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048785.038628:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097757184 00000100:00100000:1.0:1789048785.038653:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097757184 00000100:00100000:1.0:1789048785.038712:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 122 00000100:00100000:1.0:1789048785.038722:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3291a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+8:14888:x1875953097757184:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789048785.039090:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3291a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+8:14888:x1875953097757184:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 368us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048785.039108:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 122 00000100:00100000:0.0:1789048785.049850:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048785.050242:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097757312 00000100:00100000:1.0:1789048785.050253:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097757312 00000100:00100000:1.0:1789048785.050313:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 123 00000100:00100000:1.0:1789048785.050323:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3291a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+8:14908:x1875953097757312:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789048785.050552:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3291a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+8:14908:x1875953097757312:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 230us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048785.050560:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 123 00000100:00100000:2.0:1789048785.093248:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048785.094152:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097757440 00000100:00100000:1.0:1789048785.094164:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097757440 00000100:00100000:1.0:1789048785.094241:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 124 00000100:00100000:1.0:1789048785.094252:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32918050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+8:14908:x1875953097757440:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789048785.094893:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32918050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+8:14908:x1875953097757440:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 641us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048785.094902:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 124 00000100:00100000:0.0:1789048785.096954:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048785.097833:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097757568 00000100:00100000:3.0:1789048785.097849:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097757568 00000100:00100000:3.0:1789048785.097932:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 125 00000100:00100000:3.0:1789048785.097944:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32919450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+8:14908:x1875953097757568:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789048785.098625:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32919450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+8:14908:x1875953097757568:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 680us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048785.098638:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 125 00000100:00100000:3.0:1789048785.101229:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048785.101405:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097757696 00000100:00100000:2.0:1789048785.101479:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097757696 00000100:00100000:2.0:1789048785.101554:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 126 00000100:00100000:2.0:1789048785.101584:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3291b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+8:14888:x1875953097757696:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789048785.101606:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048785.101630:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba1600/0x133f221c0877740b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29af9 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048785.101668:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba1600/0x133f221c0877740b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29af9 expref: 9 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048785.101680:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba1600/0x133f221c0877740b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29af9 expref: 9 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048785.101702:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1600, rc 0) 00000100:00100000:2.0:1789048785.101774:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3291b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+9:14888:x1875953097757696:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 193us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048785.101783:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 126 00000100:00100000:2.0:1789048785.103894:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048785.104186:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097757824 00000100:00100000:3.0:1789048785.104198:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097757824 00000100:00100000:3.0:1789048785.104263:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 127 00000100:00100000:3.0:1789048785.104275:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32919c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+9:14888:x1875953097757824:12345-192.168.202.16@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789048785.104308:0:17116:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789048785.104379:0:17116:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789048785.104384:0:17116:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789048785.104387:0:17116:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789048785.104390:0:17116:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789048785.104392:0:17116:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1789048785.106388:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32919c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+9:14888:x1875953097757824:12345-192.168.202.16@tcp:256:mount.lustre.0 Request processed in 2058us (2458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048785.106406:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 127 00000100:00100000:0.0:1789048785.109771:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048785.109929:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097757952 00000100:00100000:1.0:1789048785.109942:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097757952 00000100:00100000:1.0:1789048785.110015:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 128 00000100:00100000:1.0:1789048785.110028:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+9:14888:x1875953097757952:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789048785.110061:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048785.110102:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c07060e00/0x133f221c08777412 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29b00 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048785.110143:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c07060e00/0x133f221c08777412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29b00 expref: 10 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048785.110155:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c07060e00/0x133f221c08777412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29b00 expref: 10 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048785.110165:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07060e00, rc 0) 00000100:00100000:1.0:1789048785.110235:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+10:14888:x1875953097757952:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 210us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048785.110242:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 128 00000100:00100000:2.0:1789048785.112243:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048785.112322:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097758080 00000100:00100000:3.0:1789048785.112375:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097758080 00000100:00100000:3.0:1789048785.112440:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 129 00000100:00100000:3.0:1789048785.112450:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+10:14888:x1875953097758080:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789048785.112618:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+10:14888:x1875953097758080:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 169us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048785.112626:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 129 00000100:00100000:0.0:1789048785.114457:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048785.114598:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097758208 00000100:00100000:2.0:1789048785.114609:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097758208 00000100:00100000:2.0:1789048785.114673:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 130 00000100:00100000:2.0:1789048785.114685:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+10:14888:x1875953097758208:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789048785.114877:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+10:14888:x1875953097758208:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 193us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048785.114885:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 130 00000100:00100000:0.0:1789048785.118121:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048785.119132:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097758336 00000100:00100000:1.0:1789048785.119148:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097758336 00000100:00100000:1.0:1789048785.119228:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 131 00000100:00100000:1.0:1789048785.119241:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+10:14915:x1875953097758336:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789048785.119655:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+10:14915:x1875953097758336:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 415us (1548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048785.119665:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 131 00000100:00100000:1.0:1789048785.131425:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048785.131506:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097758464 00000100:00100000:3.0:1789048785.131519:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097758464 00000100:00100000:3.0:1789048785.131587:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 132 00000100:00100000:3.0:1789048785.131600:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+10:14915:x1875953097758464:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789048785.131854:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+10:14915:x1875953097758464:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 255us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048785.131864:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 132 00000100:00100000:0.0:1789048785.152513:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048785.152631:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048785.153162:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097758592 00000100:00100000:1.0:1789048785.153177:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097758592 00000100:00100000:1.0:1789048785.153228:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097758848 00000100:00100000:1.0:1789048785.153231:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097758848 00000100:00100000:1.0:1789048785.153264:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:1.0:1789048785.153276:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1875953097758592:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789048785.153317:0:19099:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from a39ccd94-ab5b-4707-8ce7-49dceae587e6@192.168.202.16@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:1.0:1789048785.153463:0:19099:0:(genops.c:1384:class_connect()) connect: client a39ccd94-ab5b-4707-8ce7-49dceae587e6, cookie 0x133f221c08777419 00000004:00100000:1.0:1789048785.153497:0:19099:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789048785.153848:0:19099:0:(import.c:65:import_set_state_nolock()) ffff959c2a768000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789048785.153945:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:2390:x1875953097758592:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 669us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048785.153953:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:1.0:1789048785.153974:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:1.0:1789048785.153980:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1875953097758848:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789048785.153999:0:19099:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from a39ccd94-ab5b-4707-8ce7-49dceae587e6@192.168.202.16@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:1.0:1789048785.154222:0:19099:0:(genops.c:1384:class_connect()) connect: client a39ccd94-ab5b-4707-8ce7-49dceae587e6, cookie 0x133f221c08777420 00000004:00100000:1.0:1789048785.154238:0:19099:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789048785.154673:0:19099:0:(import.c:65:import_set_state_nolock()) ffff959c2a76d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789048785.155997:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:2390:x1875953097758848:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 2005us (3355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048785.156010:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1789048785.165790:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048785.165837:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048785.165875:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048785.166004:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097759104 00000100:00100000:2.0:1789048785.166017:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097759104 00000100:00100000:2.0:1789048785.166102:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097758976 00000100:00100000:2.0:1789048785.166121:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097758976 00000100:00100000:2.0:1789048785.166137:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097758720 00000100:00100000:2.0:1789048785.166139:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097758720 00000100:00100000:2.0:1789048785.166155:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:2.0:1789048785.166166:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+7:14888:x1875953097759104:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789048785.166209:0:17123:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789048785.166324:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+7:14888:x1875953097759104:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 159us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048785.166377:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:2.0:1789048785.166403:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:2.0:1789048785.166421:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:0:x1875953097758976:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789048785.166444:0:17123:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789048785.166483:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:0:x1875953097758976:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 64us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048785.166489:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:2.0:1789048785.166501:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:2.0:1789048785.166507:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:0:x1875953097758720:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789048785.166518:0:17123:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789048785.166538:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:0:x1875953097758720:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 31us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048785.166544:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00080000:0.0:1789048785.168624:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789048785.168638:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789048785.177122:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048785.177260:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097759232 00000100:00100000:2.0:1789048785.177274:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097759232 00000100:00100000:2.0:1789048785.177397:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:2.0:1789048785.177517:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:14888:x1875953097759232:12345-192.168.202.16@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789048785.178629:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:14888:x1875953097759232:12345-192.168.202.16@tcp:40:mount.lustre.0 Request processed in 1212us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048785.178643:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:2.0:1789048785.184432:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048785.185058:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097759360 00000100:00100000:3.0:1789048785.185072:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097759360 00000100:00100000:3.0:1789048785.185136:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:3.0:1789048785.185146:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1875953097759360:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789048785.185194:0:18912:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from a39ccd94-ab5b-4707-8ce7-49dceae587e6@192.168.202.16@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:3.0:1789048785.185259:0:18912:0:(genops.c:1384:class_connect()) connect: client a39ccd94-ab5b-4707-8ce7-49dceae587e6, cookie 0x133f221c08777427 00002000:00100000:3.0:1789048785.185275:0:18912:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a39ccd94-ab5b-4707-8ce7-49dceae587e6/ffff959c322c4000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789048785.185300:0:18912:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789048785.185833:0:18912:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789048785.185878:0:18912:0:(import.c:65:import_set_state_nolock()) ffff959c322c1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789048785.186013:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:2390:x1875953097759360:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 866us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048785.186022:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:1.0:1789048785.188735:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048785.188849:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048785.188989:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097759488 00000100:00100000:0.0:1789048785.189002:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097759488 00000100:00100000:0.0:1789048785.189051:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:0.0:1789048785.189060:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2390:x1875953097759488:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789048785.189107:0:18631:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from a39ccd94-ab5b-4707-8ce7-49dceae587e6@192.168.202.16@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:0.0:1789048785.189147:0:18631:0:(genops.c:1384:class_connect()) connect: client a39ccd94-ab5b-4707-8ce7-49dceae587e6, cookie 0x133f221c0877742e 00002000:00100000:0.0:1789048785.189162:0:18631:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a39ccd94-ab5b-4707-8ce7-49dceae587e6/ffff959b08c24800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789048785.189190:0:18631:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789048785.189451:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097759616 00000100:00100000:3.0:1789048785.189457:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097759616 00000100:00100000:2.0:1789048785.189550:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:2.0:1789048785.189559:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:14888:x1875953097759616:12345-192.168.202.16@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789048785.189646:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:14888:x1875953097759616:12345-192.168.202.16@tcp:900:mount.lustre.0 Request processed in 89us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048785.189655:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00002000:00080000:2.0:1789048785.189700:0:18631:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789048785.189736:0:18631:0:(import.c:65:import_set_state_nolock()) ffff959b06939000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789048785.189774:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:2390:x1875953097759488:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 714us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048785.189782:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:1.0:1789048785.191549:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048785.191639:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097759744 00000100:00100000:0.0:1789048785.191648:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097759744 00000100:00100000:0.0:1789048785.191692:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:0.0:1789048785.191702:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:14888:x1875953097759744:12345-192.168.202.16@tcp:33:mount.lustre.0 00000004:00080000:0.0:1789048785.202581:0:17125:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 10769us 00000004:00200000:0.0:1789048785.241419:0:17125:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789048785.241558:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:14888:x1875953097759744:12345-192.168.202.16@tcp:33:mount.lustre.0 Request processed in 49850us (50011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048785.241568:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:2.0:1789048785.376500:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111477120:0@lo:400:kworker.0 00000100:00100000:1.0:1789048785.376731:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111476992:0@lo:400:kworker.0 00000100:00100000:1.0:1789048785.376795:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048785.376857:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111477504:0@lo:400:kworker.0 00000100:00100000:1.0:1789048785.376880:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048785.376896:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111478016:0@lo:400:kworker.0 00000100:00100000:1.0:1789048785.376919:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048785.376958:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1789048785.376964:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111476864:0@lo:400:kworker.0 00000100:00100000:2.0:1789048785.376965:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048785.376981:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111477632:0@lo:400:kworker.0 00000100:00100000:1.0:1789048785.376989:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048785.376999:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048785.377010:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111478144:0@lo:400:kworker.0 00000100:00100000:1.0:1789048785.377010:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111477376:0@lo:400:kworker.0 00000100:00100000:1.0:1789048785.377027:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048785.377049:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111477888:0@lo:400:kworker.0 00000100:00100000:2.0:1789048785.377055:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111478016 00000100:00100000:2.0:1789048785.377061:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111478016 00000100:00100000:1.0:1789048785.377068:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048785.377082:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111478400:0@lo:400:kworker.0 00000100:00100000:2.0:1789048785.377106:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111477376 00000100:00100000:1.0:1789048785.377106:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048785.377109:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111477376 00000100:00100000:2.0:1789048785.377122:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111477888 00000100:00100000:2.0:1789048785.377124:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111477888 00000100:00100000:1.0:1789048785.377125:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111476864 00000100:00100000:1.0:1789048785.377128:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111476864 00000100:00100000:2.0:1789048785.377142:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111478400 00000100:00100000:2.0:1789048785.377145:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111478400 00000100:00100000:1.0:1789048785.377151:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789048785.377158:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789048785.377159:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3621:x1875953111476864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048785.377162:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111478016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048785.377249:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111476992 00000100:00100000:3.0:1789048785.377254:0:18100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111476992 00000100:00100000:3.0:1789048785.377295:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111477504 00000100:00100000:3.0:1789048785.377298:0:18100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111477504 00000100:00100000:3.0:1789048785.377310:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789048785.377316:0:18100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111476992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048785.377518:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3621:x1875953111476864:12345-0@lo:400:kworker.0 Request processed in 43us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048785.377526:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789048785.377560:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789048785.377567:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111477376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048785.386937:0:18100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111476992:12345-0@lo:400:kworker.0 Request processed in 9611us (10133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048785.386953:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789048785.386974:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789048785.386992:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111478528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789048785.387051:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048785.387108:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111478528 00000100:00100000:0.0:1789048785.387115:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111478528 00000100:00100000:3.0:1789048785.387137:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789048785.387146:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111477504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048785.387157:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789048785.387162:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06971c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875953111478528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789048785.387176:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789048785.387196:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111477504:12345-0@lo:400:kworker.0 Request processed in 52us (10316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048785.387202:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789048785.387233:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06971c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875953111478528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048785.387239:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789048785.387283:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111478528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048785.387299:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111477120 00000100:00100000:3.0:1789048785.387303:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111477120 00000100:00100000:0.0:1789048785.387304:0:18630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111477632 00000100:00100000:0.0:1789048785.387306:0:18630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111477632 00000100:00100000:1.0:1789048785.389067:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111477376:12345-0@lo:400:kworker.0 Request processed in 11492us (12029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048785.389083:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789048785.389119:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789048785.389133:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111477888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048785.389192:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111477888:12345-0@lo:400:kworker.0 Request processed in 66us (12122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048785.389528:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789048785.389544:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789048785.389552:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111478400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048785.389586:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111478400:12345-0@lo:400:kworker.0 Request processed in 36us (12480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048785.389592:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789048785.389785:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111476864:0@lo:400:kworker.0 00010000:00080000:1.0:1789048785.389801:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c20221500 x1875953111477376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048785.389813:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111477376:0@lo:400:kworker.0 00010000:00080000:1.0:1789048785.389822:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080d9500 x1875953111477888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048785.389830:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111477888:0@lo:400:kworker.0 00010000:00080000:1.0:1789048785.389839:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080a1500 x1875953111478400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048785.389847:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111478400:0@lo:400:kworker.0 00000100:00100000:1.0:1789048785.389858:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20222a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111476992:0@lo:400:kworker.0 00000100:00100000:1.0:1789048785.389869:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111477504:0@lo:400:kworker.0 00000100:00100000:0.0:1789048785.390095:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789048785.390107:0:18630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111477632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048785.390147:0:18630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111477632:12345-0@lo:400:kworker.0 Request processed in 44us (13147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048785.390153:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789048785.390163:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789048785.390169:0:18630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111477120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048785.390191:0:18630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111477120:12345-0@lo:400:kworker.0 Request processed in 23us (13226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048785.390196:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789048785.390785:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048785.390838:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111478656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048785.390895:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048785.390927:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111477120:0@lo:400:kworker.0 00000100:00100000:3.0:1789048785.390940:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111477632:0@lo:400:kworker.0 00000100:00100000:3.0:1789048785.391070:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789048785.391078:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111477248:0@lo:400:kworker.0 00000100:00100000:3.0:1789048785.391106:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048785.391126:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111477760:0@lo:400:kworker.0 00000100:00100000:3.0:1789048785.391147:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048785.391159:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111478272:0@lo:400:kworker.0 00000100:00100000:3.0:1789048785.391179:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048785.391194:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111478784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048785.391294:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048785.391363:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111478144 00000100:00100000:3.0:1789048785.391370:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111478144 00000100:00100000:3.0:1789048785.391404:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111478272 00000100:00100000:3.0:1789048785.391407:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111478272 00000100:00100000:3.0:1789048785.391422:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789048785.391428:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111478144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048785.391471:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111478144:12345-0@lo:400:kworker.0 Request processed in 43us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048785.391477:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789048785.391491:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789048785.391498:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111478272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048785.391524:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111478272:12345-0@lo:400:kworker.0 Request processed in 27us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048785.391536:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789048785.391555:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111478656 00000100:00100000:3.0:1789048785.391558:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111478656 00000100:00100000:3.0:1789048785.391579:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789048785.391584:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111478656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789048785.391610:0:17127:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789048785.391787:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111478656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 202us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048785.391793:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789048785.391813:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111477248 00000100:00100000:3.0:1789048785.391816:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111477248 00000100:00100000:3.0:1789048785.391831:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111477760 00000100:00100000:3.0:1789048785.391833:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111477760 00000100:00100000:3.0:1789048785.391846:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789048785.391851:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3622:x1875953111477248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048785.391876:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3622:x1875953111477248:12345-0@lo:400:kworker.0 Request processed in 26us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048785.391881:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789048785.391890:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789048785.391895:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111477760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048785.391914:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111477760:12345-0@lo:400:kworker.0 Request processed in 20us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048785.391918:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789048785.391943:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111477248:0@lo:400:kworker.0 00000100:00100000:3.0:1789048785.391951:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111477760:0@lo:400:kworker.0 00010000:00080000:3.0:1789048785.392926:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080a3100 x1875953111478272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048785.392938:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111478272:0@lo:400:kworker.0 00000100:00100000:3.0:1789048785.393401:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111478656:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1789048785.393423:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080a3480 x1875953111478144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048785.393434:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111478144:0@lo:400:kworker.0 00000100:00080000:3.0:1789048785.393527:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789048785.393532:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789048785.393535:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789048785.393538:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048785.393558:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111478784 00000100:00100000:3.0:1789048785.393564:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111478784 00000100:00100000:3.0:1789048785.393612:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789048785.393767:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111478784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789048785.393787:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789048785.393848:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111478784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (2554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048785.393855:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789048785.393886:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111478784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789048785.397733:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111478016:12345-0@lo:400:kworker.0 Request processed in 20560us (20803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048785.397748:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789048785.402481:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080a1c00 x1875953111478016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048785.402499:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111478016:0@lo:400:kworker.0 00000100:00100000:0.0:1789048785.458204:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048785.458416:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097759872 00000100:00100000:3.0:1789048785.458430:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097759872 00000100:00100000:3.0:1789048785.458510:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:3.0:1789048785.458523:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:14938:x1875953097759872:12345-192.168.202.16@tcp:101:mkdir.0 00010000:00010000:3.0:1789048785.458550:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048785.458601:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08777435 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29b31 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048785.458686:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ce00/0x133f221c0877743c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048785.458703:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ce00/0x133f221c0877743c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048785.458721:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ce00/0x133f221c0877743c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048785.458789:0:17122:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789048785.458793:0:17122:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789048785.458833:0:17122:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ce00/0x133f221c0877743c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048785.458863:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c000/0x133f221c08777435 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29b31 expref: 8 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048785.458884:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ce00/0x133f221c0877743c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29b31 expref: 7 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048785.458893:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfc100) 00010000:00010000:3.0:1789048785.458896:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789048785.458900:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3ce00, rc 0) 00000100:00100000:3.0:1789048785.459797:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+7:14938:x1875953097759872:12345-192.168.202.16@tcp:101:mkdir.0 Request processed in 1271us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048785.459809:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00010000:00010000:2.0:1789048785.503835:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789048786.412145:0:19445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a39ccd94-ab5b-4707-8ce7-49dceae587e6 00000001:00080000:2.0:1789048786.412166:0:19445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:2.0:1789048786.530691:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048787.490811:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048787.493590:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097760000 00000100:00100000:3.0:1789048787.493634:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097760000 00000100:00100000:3.0:1789048787.493767:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:3.0:1789048787.493785:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+7:14990:x1875953097760000:12345-192.168.202.16@tcp:41:lfs.0 00000100:00080000:0.0:1789048787.495793:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1789048787.496637:0:17124:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789048787.496835:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+7:14990:x1875953097760000:12345-192.168.202.16@tcp:41:lfs.0 Request processed in 3048us (6032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048787.499143:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:1.0:1789048787.504197:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048787.504303:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097760128 00000100:00100000:2.0:1789048787.504316:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097760128 00000100:00100000:2.0:1789048787.505278:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:2.0:1789048787.505295:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:14990:x1875953097760128:12345-192.168.202.16@tcp:41:lfs.0 00000004:00000024:2.0:1789048787.505427:0:17123:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789048787.505573:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:14990:x1875953097760128:12345-192.168.202.16@tcp:41:lfs.0 Request processed in 283us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048787.505580:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00080000:0.0:1789048787.506720:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789048787.511202:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048787.511973:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097760256 00000100:00100000:3.0:1789048787.511988:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097760256 00000100:00100000:3.0:1789048787.512091:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:3.0:1789048787.512105:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06970380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:14990:x1875953097760256:12345-192.168.202.16@tcp:13:lfs.0 00002000:00000024:3.0:1789048787.512149:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789048787.512376:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06970380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:14990:x1875953097760256:12345-192.168.202.16@tcp:13:lfs.0 Request processed in 231us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048787.512384:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00080000:0.0:1789048787.515456:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048787.526244:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048787.527805:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097760384 00000100:00100000:3.0:1789048787.528011:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097760384 00000100:00100000:2.0:1789048787.528375:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:2.0:1789048787.528401:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:14990:x1875953097760384:12345-192.168.202.16@tcp:13:lfs.0 00002000:00000024:2.0:1789048787.528476:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789048787.528603:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:14990:x1875953097760384:12345-192.168.202.16@tcp:13:lfs.0 Request processed in 216us (2376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048787.528633:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00080000:0.0:1789048787.541965:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789048787.550207:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048787.854765:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048787.860481:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097760512 00000100:00100000:1.0:1789048787.860504:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097760512 00000100:00100000:1.0:1789048787.860626:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 134 00000100:00100000:1.0:1789048787.860639:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+10:15022:x1875953097760512:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789048787.860663:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048787.860689:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c07060c00/0x133f221c08777443 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29b38 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048787.860732:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c07060c00/0x133f221c08777443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29b38 expref: 11 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048787.860746:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c07060c00/0x133f221c08777443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29b38 expref: 11 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048787.860758:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07060c00, rc 0) 00000100:00100000:1.0:1789048787.860862:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+11:15022:x1875953097760512:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 225us (6112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048787.860870:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 134 00000100:00100000:3.0:1789048787.867859:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048787.867978:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097760640 00000100:00100000:0.0:1789048787.867992:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097760640 00000100:00100000:0.0:1789048787.868078:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 135 00000100:00100000:0.0:1789048787.868090:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+11:15022:x1875953097760640:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789048787.868315:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+11:15022:x1875953097760640:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 227us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048787.868407:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 135 00000100:00100000:3.0:1789048787.876202:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048787.876440:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097760768 00000100:00100000:2.0:1789048787.876456:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097760768 00000100:00100000:2.0:1789048787.876545:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 136 00000100:00100000:2.0:1789048787.876558:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+11:15022:x1875953097760768:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789048787.879311:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+11:15022:x1875953097760768:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 2736us (3105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048787.879355:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 136 00000100:00100000:2.0:1789048787.885866:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048787.885999:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097760896 00000100:00100000:1.0:1789048787.886021:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097760896 00000100:00100000:1.0:1789048787.886100:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 137 00000100:00100000:1.0:1789048787.886113:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+11:15029:x1875953097760896:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789048787.886325:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+11:15029:x1875953097760896:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 214us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048787.886398:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 137 00000100:00100000:3.0:1789048787.917817:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048787.917995:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097761024 00000100:00100000:2.0:1789048787.918020:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097761024 00000100:00100000:2.0:1789048787.918105:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 138 00000100:00100000:2.0:1789048787.918117:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+11:15029:x1875953097761024:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789048787.918832:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+11:15029:x1875953097761024:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 713us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048787.918844:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 138 00000100:00100000:3.0:1789048787.933625:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048787.936080:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789048787.936114:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111478912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789048787.936212:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048787.936399:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111478912 00000100:00100000:3.0:1789048787.936411:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111478912 00000100:00100000:3.0:1789048787.936508:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789048787.936520:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111478912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789048787.936551:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789048787.936611:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111478912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048787.936637:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789048787.936701:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111478912:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789048787.936894:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789048787.939142:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097761152 00000100:00100000:0.0:1789048787.939159:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097761152 00000100:00100000:0.0:1789048787.939317:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 139 00000100:00100000:0.0:1789048787.939328:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+11:15029:x1875953097761152:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789048787.939981:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+11:15029:x1875953097761152:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 651us (6657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048787.939991:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 139 00000100:00100000:1.0:1789048787.952018:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048787.952251:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097761280 00000100:00100000:2.0:1789048787.952265:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097761280 00000100:00100000:2.0:1789048787.952376:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 140 00000100:00100000:2.0:1789048787.952398:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+11:15022:x1875953097761280:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789048787.952441:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048787.952477:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba1200/0x133f221c0877744a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29b69 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048787.952518:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba1200/0x133f221c0877744a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29b69 expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048787.952531:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba1200/0x133f221c0877744a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29b69 expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048787.952542:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1200, rc 0) 00000100:00100000:2.0:1789048787.952619:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+12:15022:x1875953097761280:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 223us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048787.952627:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 140 00000100:00100000:3.0:1789048787.956707:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048787.956870:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097761408 00000100:00100000:0.0:1789048787.956894:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097761408 00000100:00100000:0.0:1789048787.956967:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00100000:0.0:1789048787.956978:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+12:15022:x1875953097761408:12345-192.168.202.16@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789048787.957138:0:17116:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789048787.957176:0:17116:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789048787.957182:0:17116:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789048787.957185:0:17116:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789048787.957188:0:17116:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789048787.957191:0:17116:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1789048787.967931:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+12:15022:x1875953097761408:12345-192.168.202.16@tcp:256:mount.lustre.0 Request processed in 10937us (11222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048787.967948:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00100000:1.0:1789048787.974676:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048787.974805:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097761536 00000100:00100000:2.0:1789048787.974820:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097761536 00000100:00100000:2.0:1789048787.974894:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 142 00000100:00100000:2.0:1789048787.974905:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+12:15022:x1875953097761536:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789048787.974929:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048787.974953:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba0000/0x133f221c08777451 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29b70 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048787.974992:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba0000/0x133f221c08777451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29b70 expref: 13 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048787.975111:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba0000/0x133f221c08777451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29b70 expref: 13 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048787.975145:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0000, rc 0) 00000100:00100000:2.0:1789048787.975292:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+13:15022:x1875953097761536:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 386us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048787.975301:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 142 00000100:00100000:3.0:1789048787.983202:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048787.983583:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097761664 00000100:00100000:0.0:1789048787.983598:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097761664 00000100:00100000:0.0:1789048787.983717:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 143 00000100:00100000:0.0:1789048787.983728:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+13:15022:x1875953097761664:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789048787.983966:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+13:15022:x1875953097761664:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 239us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048787.983974:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 143 00000100:00100000:3.0:1789048787.987899:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048787.988117:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097761792 00000100:00100000:2.0:1789048787.988132:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097761792 00000100:00100000:2.0:1789048787.988210:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 144 00000100:00100000:2.0:1789048787.988223:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+13:15022:x1875953097761792:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789048787.988945:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+13:15022:x1875953097761792:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 720us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048787.988956:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 144 00000100:00100000:2.0:1789048788.007096:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048788.009789:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097761920 00000100:00100000:0.0:1789048788.009811:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097761920 00000100:00100000:0.0:1789048788.009918:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 145 00000100:00100000:0.0:1789048788.009932:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+13:15032:x1875953097761920:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789048788.010173:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+13:15032:x1875953097761920:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 243us (3093us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048788.010182:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 145 00000100:00100000:2.0:1789048788.013989:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048788.014172:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097762048 00000100:00100000:3.0:1789048788.014187:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097762048 00000100:00100000:3.0:1789048788.014322:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 146 00000100:00100000:3.0:1789048788.014391:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+13:15032:x1875953097762048:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789048788.014804:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+13:15032:x1875953097762048:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 471us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048788.014813:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 146 00000100:00100000:3.0:1789048788.036302:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048788.036411:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048788.036519:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097762176 00000100:00100000:1.0:1789048788.036533:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097762176 00000100:00100000:1.0:1789048788.036595:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097762432 00000100:00100000:1.0:1789048788.036598:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097762432 00000100:00100000:1.0:1789048788.036626:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:1.0:1789048788.036635:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2390:x1875953097762176:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789048788.036674:0:17124:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e75ca1a9-3972-4d73-931e-9ff32f454dcc@192.168.202.16@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:1.0:1789048788.036739:0:17124:0:(genops.c:1384:class_connect()) connect: client e75ca1a9-3972-4d73-931e-9ff32f454dcc, cookie 0x133f221c08777458 00000004:00100000:1.0:1789048788.036773:0:17124:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789048788.036816:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:2.0:1789048788.036822:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1875953097762432:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789048788.036842:0:19099:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from e75ca1a9-3972-4d73-931e-9ff32f454dcc@192.168.202.16@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:2.0:1789048788.036869:0:19099:0:(genops.c:1384:class_connect()) connect: client e75ca1a9-3972-4d73-931e-9ff32f454dcc, cookie 0x133f221c0877745f 00000004:00100000:2.0:1789048788.036884:0:19099:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789048788.036901:0:17124:0:(import.c:65:import_set_state_nolock()) ffff959c2a76e800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789048788.036937:0:19099:0:(import.c:65:import_set_state_nolock()) ffff959c1069b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789048788.037253:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:2390:x1875953097762176:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 615us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048788.037262:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:2.0:1789048788.047706:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:2390:x1875953097762432:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 10862us (11274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048788.047727:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:1.0:1789048788.057171:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048788.057253:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048788.057280:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048788.057309:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097762944 00000100:00100000:1.0:1789048788.057321:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097762944 00000100:00100000:1.0:1789048788.057424:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097762816 00000100:00100000:1.0:1789048788.057438:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097762816 00000100:00100000:1.0:1789048788.057473:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:1.0:1789048788.057485:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:2391:x1875953097762944:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048788.057576:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:2391:x1875953097762944:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 92us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048788.057584:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:1.0:1789048788.057603:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:1.0:1789048788.057619:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+7:2391:x1875953097762816:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048788.057647:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+7:2391:x1875953097762816:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 30us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048788.057652:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:1.0:1789048788.057707:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048788.057743:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097763200 00000100:00100000:1.0:1789048788.057747:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097763200 00000100:00100000:1.0:1789048788.057773:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097763072 00000100:00100000:1.0:1789048788.057776:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097763072 00000100:00100000:1.0:1789048788.057795:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:1.0:1789048788.057801:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2391:x1875953097763200:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048788.057828:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2391:x1875953097763200:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048788.057835:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:1.0:1789048788.057847:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:1.0:1789048788.057853:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:2391:x1875953097763072:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048788.057878:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:2391:x1875953097763072:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048788.057885:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:2.0:1789048788.065757:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048788.065857:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048788.065946:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097762688 00000100:00100000:3.0:1789048788.065960:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097762688 00000100:00100000:0.0:1789048788.066036:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097762304 00000100:00100000:0.0:1789048788.066041:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097762304 00000100:00100000:0.0:1789048788.066103:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:0.0:1789048788.066116:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+7:0:x1875953097762304:12345-192.168.202.16@tcp:41:mount.lustre.0 00000100:00080000:2.0:1789048788.066127:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1789048788.066162:0:17122:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789048788.066284:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+7:0:x1875953097762304:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 168us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048788.066294:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:2.0:1789048788.067510:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:2.0:1789048788.067531:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:15022:x1875953097762688:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789048788.067565:0:17124:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789048788.067633:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:15022:x1875953097762688:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 110us (1891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048788.067640:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:2.0:1789048788.103644:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048788.103694:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048788.103840:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097763328 00000100:00100000:1.0:1789048788.103855:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097763328 00000100:00100000:1.0:1789048788.103935:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097762560 00000100:00100000:1.0:1789048788.103939:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097762560 00000100:00100000:1.0:1789048788.103995:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:1.0:1789048788.104006:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:15022:x1875953097763328:12345-192.168.202.16@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789048788.104134:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:15022:x1875953097763328:12345-192.168.202.16@tcp:40:mount.lustre.0 Request processed in 129us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048788.104143:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:1.0:1789048788.104167:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:1.0:1789048788.104174:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:0:x1875953097762560:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789048788.104192:0:17123:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789048788.104234:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:0:x1875953097762560:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 61us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048788.104240:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00080000:2.0:1789048788.104714:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048788.123492:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048788.123534:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048788.123558:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048788.123700:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097763456 00000100:00100000:0.0:1789048788.123712:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097763456 00000100:00100000:0.0:1789048788.123758:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097763584 00000100:00100000:0.0:1789048788.123760:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097763584 00000100:00100000:0.0:1789048788.123783:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:0.0:1789048788.123793:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1875953097763456:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789048788.123834:0:18912:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e75ca1a9-3972-4d73-931e-9ff32f454dcc@192.168.202.16@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:0.0:1789048788.123871:0:18912:0:(genops.c:1384:class_connect()) connect: client e75ca1a9-3972-4d73-931e-9ff32f454dcc, cookie 0x133f221c08777466 00002000:00100000:0.0:1789048788.123885:0:18912:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e75ca1a9-3972-4d73-931e-9ff32f454dcc/ffff959b08c23800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789048788.123916:0:18912:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789048788.124028:0:18912:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789048788.124065:0:18912:0:(import.c:65:import_set_state_nolock()) ffff959b08c26000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789048788.124138:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:2390:x1875953097763456:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 346us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048788.124147:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:0.0:1789048788.124165:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:0.0:1789048788.124170:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1875953097763584:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789048788.124186:0:18912:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e75ca1a9-3972-4d73-931e-9ff32f454dcc@192.168.202.16@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:0.0:1789048788.124202:0:18912:0:(genops.c:1384:class_connect()) connect: client e75ca1a9-3972-4d73-931e-9ff32f454dcc, cookie 0x133f221c0877746d 00002000:00100000:0.0:1789048788.124207:0:18912:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e75ca1a9-3972-4d73-931e-9ff32f454dcc/ffff959b08c20000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789048788.124213:0:18912:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789048788.124256:0:18912:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789048788.124268:0:18912:0:(import.c:65:import_set_state_nolock()) ffff959b08c22000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789048788.124288:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:2390:x1875953097763584:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 117us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048788.124294:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:2.0:1789048788.124571:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097763712 00000100:00100000:2.0:1789048788.124577:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097763712 00000100:00100000:2.0:1789048788.124626:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:2.0:1789048788.124633:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:15022:x1875953097763712:12345-192.168.202.16@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789048788.124670:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:15022:x1875953097763712:12345-192.168.202.16@tcp:900:mount.lustre.0 Request processed in 39us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048788.124676:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:1.0:1789048788.128097:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048788.128287:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097763840 00000100:00100000:0.0:1789048788.128301:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097763840 00000100:00100000:0.0:1789048788.128434:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:0.0:1789048788.128447:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:15022:x1875953097763840:12345-192.168.202.16@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789048788.128710:0:17126:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789048788.128821:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:15022:x1875953097763840:12345-192.168.202.16@tcp:33:mount.lustre.0 Request processed in 376us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048788.128841:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:2.0:1789048788.328782:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048788.333766:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097763968 00000100:00100000:1.0:1789048788.333792:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097763968 00000100:00100000:1.0:1789048788.333893:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:1.0:1789048788.333907:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:15055:x1875953097763968:12345-192.168.202.16@tcp:101:mkdir.0 00010000:00010000:1.0:1789048788.333936:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048788.333971:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061800/0x133f221c08777474 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29ba1 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048788.334073:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877747b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048788.334091:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877747b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048788.334107:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877747b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048788.334196:0:17123:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789048788.334200:0:17123:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789048788.334574:0:17123:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877747b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048788.334609:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061800/0x133f221c08777474 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29ba1 expref: 8 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048788.334631:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877747b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29ba1 expref: 7 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048788.334641:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfc100) 00010000:00010000:1.0:1789048788.334644:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789048788.334648:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07061200, rc 0) 00000100:00100000:1.0:1789048788.334745:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+7:15055:x1875953097763968:12345-192.168.202.16@tcp:101:mkdir.0 Request processed in 840us (5978us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048788.334755:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00010000:00010000:2.0:1789048788.576440:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048788.958109:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111479040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048788.958237:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048788.962046:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111479040 00000100:00100000:2.0:1789048788.962069:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111479040 00000100:00080000:0.0:1789048788.962174:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048788.962195:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789048788.962208:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111479040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789048788.962246:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789048788.962418:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111479040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 214us (4191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048788.962449:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789048788.962809:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111479040:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789048789.599571:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048789.986224:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789048789.986259:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111479168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048789.986392:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048789.986580:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111479168 00000100:00100000:2.0:1789048789.986590:0:18100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111479168 00000100:00100000:2.0:1789048789.986778:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789048789.986791:0:18100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111479168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789048789.986840:0:18100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789048789.986902:0:18100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111479168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048789.986910:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789048789.986967:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111479168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048790.493680:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789048790.493712:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111479296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048790.493808:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048790.493961:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111479296 00000100:00100000:3.0:1789048790.493974:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111479296 00000100:00100000:3.0:1789048790.494068:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789048790.494082:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111479296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789048790.494139:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789048790.494200:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111479296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048790.494208:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1789048790.494289:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789048790.494387:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111479296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048790.494545:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111479424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048790.494587:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048790.494946:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111479808:0@lo:400:kworker.0 00000100:00100000:2.0:1789048790.494984:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048790.495005:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111480320:0@lo:400:kworker.0 00000100:00100000:2.0:1789048790.495032:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048790.495068:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111480832:0@lo:400:kworker.0 00000100:00100000:2.0:1789048790.495094:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048790.495112:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789048790.495118:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111479680:0@lo:400:kworker.0 00000100:00100000:2.0:1789048790.495140:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048790.495155:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111480192:0@lo:400:kworker.0 00000100:00100000:2.0:1789048790.495178:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048790.495193:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111480704:0@lo:400:kworker.0 00000100:00100000:2.0:1789048790.495218:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048790.495247:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111480320 00000100:00100000:2.0:1789048790.495264:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111480320 00000100:00100000:2.0:1789048790.495302:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111480832 00000100:00100000:2.0:1789048790.495318:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111480832 00000100:00100000:2.0:1789048790.495363:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111480704 00000100:00100000:2.0:1789048790.495366:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111480704 00000100:00100000:2.0:1789048790.495383:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789048790.495391:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111480320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048790.495439:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111480320:12345-0@lo:400:kworker.0 Request processed in 48us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048790.495446:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789048790.495468:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789048790.495475:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111480832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048790.495505:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111480832:12345-0@lo:400:kworker.0 Request processed in 31us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048790.495670:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789048790.495683:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789048790.495690:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111480704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048790.495724:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111480704:12345-0@lo:400:kworker.0 Request processed in 35us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048790.495729:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789048790.495772:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111480704:0@lo:400:kworker.0 00000100:00100000:2.0:1789048790.495783:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111480320:0@lo:400:kworker.0 00010000:00080000:2.0:1789048790.495796:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c03e57480 x1875953111480832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048790.495809:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111480832:0@lo:400:kworker.0 00000100:00100000:0.0:1789048790.496190:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111479808 00000100:00100000:0.0:1789048790.496197:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111479808 00000100:00100000:0.0:1789048790.496247:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111479680 00000100:00100000:0.0:1789048790.496250:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111479680 00000100:00100000:0.0:1789048790.496271:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111480192 00000100:00100000:0.0:1789048790.496275:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111480192 00000100:00100000:2.0:1789048790.496283:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789048790.496295:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111479808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048790.496300:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789048790.496323:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111479680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048790.496389:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111479808:12345-0@lo:400:kworker.0 Request processed in 96us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048790.496397:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789048790.496404:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111479680:12345-0@lo:400:kworker.0 Request processed in 83us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048790.496412:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789048790.496426:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789048790.496435:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c310a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111480192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048790.496468:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c310a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111480192:12345-0@lo:400:kworker.0 Request processed in 34us (1288us total) trans 0 rc 0/0 00000100:00080000:1.0:1789048790.496545:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789048790.496557:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789048790.496560:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789048790.496563:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789048790.496599:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111479552:0@lo:400:kworker.0 00000100:00100000:3.0:1789048790.496702:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111479424 00000100:00100000:3.0:1789048790.496706:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111479424 00000100:00100000:3.0:1789048790.496737:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789048790.496743:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111479424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789048790.496772:0:17128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789048790.496807:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111479424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (2220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048790.496812:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789048790.496861:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111479680:0@lo:400:kworker.0 00000100:00100000:3.0:1789048790.496871:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111480192:0@lo:400:kworker.0 00000100:00100000:3.0:1789048790.496879:0:3623:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1789048790.496891:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111479808:0@lo:400:kworker.0 00000100:00100000:3.0:1789048790.496931:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111479936:0@lo:400:kworker.0 00000100:00100000:3.0:1789048790.496954:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048790.496976:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048790.497007:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111480064:0@lo:400:kworker.0 00000100:00100000:1.0:1789048790.497028:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048790.497046:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111480576:0@lo:400:kworker.0 00000100:00100000:1.0:1789048790.497067:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048790.497100:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111480064 00000100:00100000:1.0:1789048790.497104:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111480064 00000100:00100000:1.0:1789048790.497132:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789048790.497139:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111480064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048790.497175:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111480064:12345-0@lo:400:kworker.0 Request processed in 36us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048790.497181:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789048790.497200:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111479936 00000100:00100000:1.0:1789048790.497203:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111479936 00000100:00100000:1.0:1789048790.497224:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111480576 00000100:00100000:1.0:1789048790.497227:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111480576 00000100:00100000:1.0:1789048790.497253:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789048790.497259:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111479936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048790.497288:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111479936:12345-0@lo:400:kworker.0 Request processed in 29us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048790.497294:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789048790.497318:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789048790.497325:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111480576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048790.497397:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111480576:12345-0@lo:400:kworker.0 Request processed in 72us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048790.497403:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789048790.497424:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789048790.497445:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111480064:0@lo:400:kworker.0 00010000:00080000:1.0:1789048790.497456:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c03e55c00 x1875953111480576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048790.497467:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111480576:0@lo:400:kworker.0 00000100:00100000:1.0:1789048790.497628:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111479552 00000100:00100000:1.0:1789048790.497633:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111479552 00000100:00100000:1.0:1789048790.497663:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789048790.497669:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3621:x1875953111479552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048790.497706:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3621:x1875953111479552:12345-0@lo:400:kworker.0 Request processed in 37us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048790.497713:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789048790.497750:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111479552:0@lo:400:kworker.0 00000100:00100000:3.0:1789048790.497847:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111479936:0@lo:400:kworker.0 00000100:00100000:3.0:1789048790.497855:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111480448:0@lo:400:kworker.0 00000100:00100000:3.0:1789048790.497878:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048790.497901:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111480960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048790.497923:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048790.497965:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111479424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048790.497994:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111480960 00000100:00100000:3.0:1789048790.497997:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111480960 00000100:00100000:3.0:1789048790.498024:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789048790.498030:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111480960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789048790.498046:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789048790.498081:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111480960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048790.498087:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789048790.498114:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111480960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789048790.499423:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111480448 00000100:00100000:1.0:1789048790.499436:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111480448 00000100:00100000:1.0:1789048790.499505:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789048790.499523:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111480448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048790.499603:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111480448:12345-0@lo:400:kworker.0 Request processed in 83us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048790.499610:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1789048790.499956:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048790.499996:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111480448:0@lo:400:kworker.0 00000100:00100000:2.0:1789048790.502706:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1789048790.621891:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789048791.007987:0:17102:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e75ca1a9-3972-4d73-931e-9ff32f454dcc 00000001:00100000:3.0:1789048791.008005:0:17102:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a39ccd94-ab5b-4707-8ce7-49dceae587e6 00000001:00100000:1.0:1789048791.011923:0:18626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e75ca1a9-3972-4d73-931e-9ff32f454dcc 00000001:00100000:1.0:1789048791.011942:0:18626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a39ccd94-ab5b-4707-8ce7-49dceae587e6 00000001:00100000:3.0:1789048791.018828:0:17856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e75ca1a9-3972-4d73-931e-9ff32f454dcc 00000001:00100000:3.0:1789048791.018851:0:17856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a39ccd94-ab5b-4707-8ce7-49dceae587e6 00000040:00080000:3.0:1789048791.199023:0:17877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1789048791.559786:0:20000:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789048791.648038:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048792.669808:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048793.053578:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789048793.053613:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111481088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789048793.053713:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048793.053824:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111481088 00000100:00100000:3.0:1789048793.053836:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111481088 00000100:00100000:3.0:1789048793.053916:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789048793.053927:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111481088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789048793.053969:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789048793.054028:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111481088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048793.054054:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789048793.054135:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111481088:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789048793.054222:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789048793.151295:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048793.151381:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048793.151417:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048793.151441:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048793.151462:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048793.151481:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048793.151498:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048793.151517:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048793.151544:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048793.151575:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097764608 00000100:00100000:1.0:1789048793.151588:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097764608 00000100:00100000:1.0:1789048793.151673:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097765120 00000100:00100000:1.0:1789048793.151677:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097765120 00000100:00100000:1.0:1789048793.151693:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097764480 00000100:00100000:1.0:1789048793.151696:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097764480 00000100:00100000:1.0:1789048793.151711:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097764992 00000100:00100000:1.0:1789048793.151713:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097764992 00000100:00100000:1.0:1789048793.151733:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:1.0:1789048793.151745:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2392:x1875953097764608:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048793.151844:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2392:x1875953097764608:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 101us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048793.151853:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:1.0:1789048793.151874:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:1.0:1789048793.151881:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:2392:x1875953097765120:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048793.151907:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:2392:x1875953097765120:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048793.151913:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:1.0:1789048793.151940:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:1.0:1789048793.151946:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2392:x1875953097764480:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048793.151972:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2392:x1875953097764480:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048793.151977:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:1.0:1789048793.151987:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:1.0:1789048793.151994:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2392:x1875953097764992:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048793.152018:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2392:x1875953097764992:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 25us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048793.152024:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:1.0:1789048793.152045:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097764352 00000100:00100000:1.0:1789048793.152050:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097764352 00000100:00100000:1.0:1789048793.152075:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097764864 00000100:00100000:1.0:1789048793.152079:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097764864 00000100:00100000:1.0:1789048793.152092:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097764224 00000100:00100000:1.0:1789048793.152094:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097764224 00000100:00100000:1.0:1789048793.152107:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097764736 00000100:00100000:1.0:1789048793.152110:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097764736 00000100:00100000:1.0:1789048793.152123:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:1.0:1789048793.152129:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2392:x1875953097764352:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048793.152159:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2392:x1875953097764352:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 30us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048793.152166:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:1.0:1789048793.152178:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:1.0:1789048793.152185:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2392:x1875953097764864:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048793.152227:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2392:x1875953097764864:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 43us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048793.152239:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:1.0:1789048793.152254:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:1.0:1789048793.152260:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:2392:x1875953097764224:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048793.152298:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:2392:x1875953097764224:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 38us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048793.152303:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:1.0:1789048793.152315:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:1.0:1789048793.152321:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:2392:x1875953097764736:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048793.152380:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:2392:x1875953097764736:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 59us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048793.152386:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00080000:1.0:1789048793.152422:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789048793.152428:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789048793.152431:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789048793.152433:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789048793.153108:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097764096 00000100:00100000:3.0:1789048793.153119:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097764096 00000100:00100000:3.0:1789048793.153237:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 148 00000100:00100000:3.0:1789048793.153247:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+13:2392:x1875953097764096:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048793.153314:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+13:2392:x1875953097764096:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 70us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048793.153321:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 148 00010000:00010000:2.0:1789048793.693783:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048794.078241:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789048794.078267:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111481216:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1789048794.078361:0:17157:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789048794.078384:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048794.078456:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111481216 00000100:00100000:1.0:1789048794.078465:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111481216 00000100:00100000:1.0:1789048794.078554:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789048794.078567:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111481216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789048794.078597:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789048794.078655:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111481216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048794.078675:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789048794.078740:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111481216:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789048794.078751:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1789048794.082305:0:19445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e75ca1a9-3972-4d73-931e-9ff32f454dcc 00010000:00010000:2.0:1789048794.717723:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048795.112302:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789048795.112354:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111481344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789048795.112467:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048795.112568:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111481344 00000100:00100000:0.0:1789048795.112580:0:18100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111481344 00000100:00100000:0.0:1789048795.112648:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789048795.112661:0:18100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111481344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789048795.113212:0:18100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789048795.113308:0:18100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111481344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 648us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048795.113373:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789048795.113568:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111481344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789048795.614428:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111481472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048795.614503:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048795.614582:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111481472 00000100:00100000:3.0:1789048795.614601:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111481472 00000100:00100000:3.0:1789048795.614658:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789048795.614669:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111481472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789048795.614704:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789048795.614748:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111481472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048795.614755:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1789048795.614778:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789048795.614819:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111481472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789048795.615733:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111481728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048795.615772:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048795.616032:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111481728 00000100:00100000:1.0:1789048795.616038:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111481728 00000100:00100000:1.0:1789048795.616087:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789048795.616095:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111481728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789048795.616110:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789048795.616146:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111481728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048795.616152:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789048795.616184:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111481728:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789048795.616534:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789048795.616753:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111481600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048795.616790:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048795.617003:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111482240:0@lo:400:kworker.0 00000100:00100000:3.0:1789048795.617042:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048795.617531:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111481600 00000100:00100000:0.0:1789048795.617539:0:18100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111481600 00000100:00100000:0.0:1789048795.617577:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111482240 00000100:00100000:0.0:1789048795.617579:0:18100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111482240 00000100:00100000:0.0:1789048795.617603:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789048795.617610:0:18100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111481600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789048795.617641:0:18100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789048795.617681:0:18100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111481600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048795.617688:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789048795.617701:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789048795.617707:0:18100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111482240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048795.617729:0:18100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111482240:12345-0@lo:400:kworker.0 Request processed in 22us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048795.617735:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789048795.617753:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111481984:0@lo:400:kworker.0 00000100:00100000:0.0:1789048795.617776:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048795.617794:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111482496:0@lo:400:kworker.0 00000100:00100000:0.0:1789048795.617812:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048795.617826:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111483008:0@lo:400:kworker.0 00000100:00100000:0.0:1789048795.617845:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048795.617861:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789048795.617866:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111482112:0@lo:400:kworker.0 00000100:00100000:0.0:1789048795.617894:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048795.617907:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111482624:0@lo:400:kworker.0 00000100:00100000:0.0:1789048795.617923:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048795.617945:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111481984 00000100:00100000:0.0:1789048795.617948:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111481984 00000100:00100000:0.0:1789048795.617979:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789048795.617985:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111481984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048795.618012:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111481984:12345-0@lo:400:kworker.0 Request processed in 28us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048795.618018:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789048795.618032:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111482496 00000100:00100000:0.0:1789048795.618035:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111482496 00000100:00100000:0.0:1789048795.618049:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111483008 00000100:00100000:0.0:1789048795.618050:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111483008 00000100:00100000:0.0:1789048795.618138:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111482112 00000100:00100000:0.0:1789048795.618142:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111482112 00000100:00100000:0.0:1789048795.618152:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111482624 00000100:00100000:0.0:1789048795.618154:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111482624 00000100:00100000:0.0:1789048795.618167:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789048795.618172:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111482496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048795.618200:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111482496:12345-0@lo:400:kworker.0 Request processed in 28us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048795.618206:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789048795.618216:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789048795.618221:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111483008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048795.618240:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111483008:12345-0@lo:400:kworker.0 Request processed in 19us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048795.618254:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789048795.618278:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789048795.618283:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111482112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048795.618319:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111482112:12345-0@lo:400:kworker.0 Request processed in 36us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048795.618324:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789048795.618355:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789048795.618361:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111482624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048795.618635:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111482240:0@lo:400:kworker.0 00000100:00100000:3.0:1789048795.618643:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111482752:0@lo:400:kworker.0 00000100:00100000:2.0:1789048795.618786:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111481856:0@lo:400:kworker.0 00000100:00100000:3.0:1789048795.618907:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048795.618983:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111481600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048795.620048:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111482752 00000100:00100000:1.0:1789048795.620068:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111482752 00000100:00100000:1.0:1789048795.620122:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789048795.620130:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111482752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048795.620192:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111482752:12345-0@lo:400:kworker.0 Request processed in 62us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048795.620199:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1789048795.620400:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08845880 x1875953111482752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048795.620414:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111482752:0@lo:400:kworker.0 00000100:00080000:1.0:1789048795.620551:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789048795.620556:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789048795.620559:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789048795.622047:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048795.622114:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111482368:0@lo:400:kworker.0 00000100:00100000:3.0:1789048795.622152:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048795.622182:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111482880:0@lo:400:kworker.0 00000100:00100000:3.0:1789048795.622208:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048795.622279:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111482880 00000100:00100000:3.0:1789048795.622286:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111482880 00000100:00100000:3.0:1789048795.622903:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789048795.622914:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111482880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048795.622977:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111482880:12345-0@lo:400:kworker.0 Request processed in 64us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048795.622983:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1789048795.623005:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048795.623037:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111482880:0@lo:400:kworker.0 00000100:00100000:2.0:1789048795.623142:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111482368 00000100:00100000:2.0:1789048795.623166:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111482368 00000100:00100000:2.0:1789048795.623205:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789048795.623212:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111482368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048795.623269:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111482368:12345-0@lo:400:kworker.0 Request processed in 42us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048795.623276:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789048795.623307:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111482368:0@lo:400:kworker.0 00000100:00100000:1.0:1789048795.623712:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111481856 00000100:00100000:1.0:1789048795.623717:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111481856 00000100:00100000:1.0:1789048795.623763:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789048795.623770:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3623:x1875953111481856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048795.623816:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3623:x1875953111481856:12345-0@lo:400:kworker.0 Request processed in 47us (1774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048795.623830:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789048795.624098:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111481856:0@lo:400:kworker.0 00000100:00100000:0.0:1789048795.624234:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111482624:12345-0@lo:400:kworker.0 Request processed in 5872us (6308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048795.624243:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789048795.624411:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111482112:0@lo:400:kworker.0 00000100:00100000:2.0:1789048795.624423:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111482624:0@lo:400:kworker.0 00000100:00100000:2.0:1789048795.624435:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111481984:0@lo:400:kworker.0 00000100:00100000:2.0:1789048795.624446:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111482496:0@lo:400:kworker.0 00010000:00080000:2.0:1789048795.624460:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08847480 x1875953111483008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048795.624470:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111483008:0@lo:400:kworker.0 00010000:00010000:2.0:1789048795.748232:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789048795.883271:0:20148:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcae35bcf0 20000000:00000080:1.0:1789048795.883293:0:20148:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff959b08a08000 uarg=0000000000000000 20000000:01000000:1.0:1789048795.883774:0:20148:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789048795.883782:0:20148:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789048795.883787:0:20148:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789048795.887153:0:20149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1789048795.888101:0:20148:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789048795.895171:0:20148:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789048795.895931:0:20148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff959c3ef38c00/0x133f221c08777482 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.895956:0:20148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c04cb1000/0x133f221c08777117 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777110 expref: 23 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.895965:0:20148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959b07ba1800/0x133f221c08777125 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c0877711e expref: 23 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.895972:0:20148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959b07ba0800/0x133f221c08777164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c0877715d expref: 23 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.895979:0:20148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c07061000/0x133f221c087772c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087772bb expref: 23 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.895988:0:20148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c07060e00/0x133f221c08777412 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29b00 expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.896016:0:20148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959b07ba0000/0x133f221c08777451 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29b70 expref: 12 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.896023:0:20148:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959c3ef38c00/0x133f221c08777482 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.896076:0:20148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959b07ba0000/0x133f221c08777451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29b70 expref: 12 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.896092:0:20148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959b07ba0000/0x133f221c08777451 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29b70 expref: 12 pid: 17117 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048795.896107:0:20148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08886d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20148:1875953111483136:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048795.896262:0:20148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c07060e00/0x133f221c08777412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29b00 expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.896272:0:20148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c07060e00/0x133f221c08777412 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29b00 expref: 12 pid: 17115 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048795.896282:0:20148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08884000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20148:1875953111483264:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048795.896359:0:20148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c07061000/0x133f221c087772c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c087772bb expref: 23 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.896368:0:20148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c07061000/0x133f221c087772c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c087772bb expref: 23 pid: 17116 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048795.896378:0:20148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08885f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20148:1875953111483392:0@lo:104: 00000100:00100000:0.0:1789048795.896422:0:20148:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789048795.896473:0:20148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959b07ba0800/0x133f221c08777164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c0877715d expref: 23 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.896483:0:20148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959b07ba0800/0x133f221c08777164 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c0877715d expref: 23 pid: 17116 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048795.896491:0:20148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08885500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20148:1875953111483520:0@lo:104: 00000100:00100000:0.0:1789048795.896513:0:20148:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789048795.896550:0:20148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959b07ba1800/0x133f221c08777125 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c0877711e expref: 23 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.896558:0:20148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959b07ba1800/0x133f221c08777125 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c0877711e expref: 23 pid: 17117 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048795.896565:0:20148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08885180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20148:1875953111483648:0@lo:104: 00000100:00100000:0.0:1789048795.896596:0:20148:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789048795.896613:0:20148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c04cb1000/0x133f221c08777117 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08777110 expref: 23 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.896621:0:20148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c04cb1000/0x133f221c08777117 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08777110 expref: 23 pid: 17116 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048795.896629:0:20148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08884a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20148:1875953111483776:0@lo:104: 00000100:00100000:0.0:1789048795.896649:0:20148:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048795.896658:0:20148:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef3ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1789048795.896753:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111483392 00000100:00100000:2.0:1789048795.896763:0:17106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111483392 00000100:00100000:2.0:1789048795.896801:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111483520 00000100:00100000:2.0:1789048795.896804:0:17106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111483520 00000100:00100000:2.0:1789048795.896812:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111483648 00000100:00100000:2.0:1789048795.896814:0:17106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111483648 00000100:00100000:2.0:1789048795.896822:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111483776 00000100:00100000:2.0:1789048795.896824:0:17106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111483776 00000100:00100000:2.0:1789048795.896837:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789048795.896852:0:17106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+6:20148:x1875953111483392:12345-0@lo:104: 00010000:00010000:2.0:1789048795.896865:0:17106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c087772bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087772c2 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.896928:0:17106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789048795.896935:0:17106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+6:20148:x1875953111483392:12345-0@lo:104: Request processed in 84us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048795.896942:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789048795.896969:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789048795.896975:0:17106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08885880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+5:20148:x1875953111483520:12345-0@lo:104: 00010000:00010000:2.0:1789048795.896983:0:17106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c04cb0800/0x133f221c0877715d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777164 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897015:0:17106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789048795.897020:0:17106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08885880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+5:20148:x1875953111483520:12345-0@lo:104: Request processed in 45us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048795.897025:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789048795.897037:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789048795.897043:0:17106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08887800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+4:20148:x1875953111483648:12345-0@lo:104: 00010000:00010000:2.0:1789048795.897050:0:17106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c04cb0c00/0x133f221c0877711e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777125 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897074:0:17106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789048795.897079:0:17106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08887800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+4:20148:x1875953111483648:12345-0@lo:104: Request processed in 37us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048795.897085:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789048795.897096:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789048795.897108:0:17106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08886680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+3:20148:x1875953111483776:12345-0@lo:104: 00010000:00010000:2.0:1789048795.897115:0:17106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959b07ba1000/0x133f221c08777110 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777117 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897143:0:17106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789048795.897148:0:17106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08886680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+3:20148:x1875953111483776:12345-0@lo:104: Request processed in 41us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048795.897153:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789048795.897168:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789048795.897174:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c087772bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087772c2 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897181:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08365200 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048795.897186:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c087772bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c087772c2 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897194:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c087772bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c087772c2 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048795.897200:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c087772bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c087772c2 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048795.897206:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789048795.897236:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c087772bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087772c2 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897242:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048795.897271:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c087772bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087772c2 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897288:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959b08365200/0x133f221c087772bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087772c2 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897301:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789048795.897304:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c04cb0800/0x133f221c0877715d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777164 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897310:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0800 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048795.897313:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c04cb0800/0x133f221c0877715d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08777164 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897320:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c04cb0800/0x133f221c0877715d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08777164 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048795.897326:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c04cb0800/0x133f221c0877715d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08777164 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048795.897354:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789048795.897370:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c04cb0800/0x133f221c0877715d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777164 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897376:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048795.897389:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c04cb0800/0x133f221c0877715d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777164 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897396:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c04cb0800/0x133f221c0877715d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777164 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897405:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789048795.897414:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c04cb0c00/0x133f221c0877711e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777125 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897420:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb0c00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048795.897423:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c04cb0c00/0x133f221c0877711e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08777125 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897430:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c04cb0c00/0x133f221c0877711e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08777125 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048795.897436:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c04cb0c00/0x133f221c0877711e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08777125 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048795.897441:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789048795.897455:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c04cb0c00/0x133f221c0877711e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777125 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897462:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048795.897468:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c04cb0c00/0x133f221c0877711e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777125 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897474:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c04cb0c00/0x133f221c0877711e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777125 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897484:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048795.897486:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959b07ba1000/0x133f221c08777110 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777117 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897491:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1000 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048795.897493:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959b07ba1000/0x133f221c08777110 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08777117 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897509:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959b07ba1000/0x133f221c08777110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08777117 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048795.897514:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959b07ba1000/0x133f221c08777110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08777117 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048795.897519:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789048795.897531:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959b07ba1000/0x133f221c08777110 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777117 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897536:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048795.897543:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959b07ba1000/0x133f221c08777110 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777117 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897549:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959b07ba1000/0x133f221c08777110 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777117 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897562:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048795.897563:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048795.897564:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048795.897571:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048795.897590:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111484288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048795.897619:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048795.897646:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789048795.897652:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111483904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048795.897670:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048795.897690:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111484160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048795.897709:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048795.897733:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789048795.897739:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111484032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048795.897760:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048795.897784:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111484288 00000100:00100000:2.0:1789048795.897789:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111484288 00010000:00010000:2.0:1789048795.897806:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c04cb1000/0x133f221c08777117 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08777110 expref: 24 pid: 17116 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048795.897822:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111483904 00000100:00100000:2.0:1789048795.897825:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111483904 00010000:00010000:2.0:1789048795.897835:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c07061000/0x133f221c087772c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087772bb expref: 25 pid: 17116 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048795.897846:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111484160 00000100:00100000:2.0:1789048795.897848:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111484160 00010000:00010000:2.0:1789048795.897857:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959b07ba1800/0x133f221c08777125 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c0877711e expref: 26 pid: 17117 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048795.897867:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111484032 00000100:00100000:2.0:1789048795.897870:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111484032 00010000:00010000:2.0:1789048795.897879:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959b07ba0800/0x133f221c08777164 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c0877715d expref: 27 pid: 17116 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048795.897892:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789048795.897897:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+27:3620:x1875953111484288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048795.897907:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048795.897912:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c04cb1000/0x133f221c08777117 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08777110 expref: 27 pid: 17116 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897920:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c04cb1000/0x133f221c08777117 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08777110 expref: 27 pid: 17116 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.897946:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048795.897976:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+27:3620:x1875953111484288:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048795.897984:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789048795.897998:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789048795.898004:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+26:3620:x1875953111483904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048795.898012:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048795.898017:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c07061000/0x133f221c087772c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087772bb expref: 26 pid: 17116 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.898025:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c07061000/0x133f221c087772c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c087772bb expref: 26 pid: 17116 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.898034:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048795.898055:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+26:3620:x1875953111483904:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048795.898060:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789048795.898072:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789048795.898078:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+25:3623:x1875953111484160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048795.898086:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048795.898089:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959b07ba1800/0x133f221c08777125 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c0877711e expref: 25 pid: 17117 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.898097:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959b07ba1800/0x133f221c08777125 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c0877711e expref: 25 pid: 17117 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.898106:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048795.898139:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+25:3623:x1875953111484160:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048795.898145:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789048795.898157:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789048795.898163:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3623:x1875953111484032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048795.898170:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048795.898175:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959b07ba0800/0x133f221c08777164 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c0877715d expref: 24 pid: 17116 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.898183:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959b07ba0800/0x133f221c08777164 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c0877715d expref: 24 pid: 17116 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048795.898192:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048795.898213:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3623:x1875953111484032:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048795.898219:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789048795.898282:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111484032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048795.898293:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111484160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048795.898321:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111483904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048795.898328:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111484288:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789048795.898783:0:20148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c07061000/0x133f221c087772c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c087772bb expref: 23 pid: 17116 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048795.898798:0:20148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08885f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20148:1875953111483392:0@lo:104: 00010000:00010000:0.0:1789048795.898809:0:20148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b07ba0800/0x133f221c08777164 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c0877715d expref: 22 pid: 17116 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048795.898827:0:20148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08885500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20148:1875953111483520:0@lo:104: 00010000:00010000:0.0:1789048795.898839:0:20148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b07ba1800/0x133f221c08777125 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c0877711e expref: 21 pid: 17117 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048795.898847:0:20148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08885180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20148:1875953111483648:0@lo:104: 00010000:00010000:0.0:1789048795.898856:0:20148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c04cb1000/0x133f221c08777117 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08777110 expref: 20 pid: 17116 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048795.898863:0:20148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08884a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20148:1875953111483776:0@lo:104: 00000100:00100000:0.0:1789048795.905263:0:20148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08886d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20148:1875953111483136:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789048795.905280:0:20148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08884000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20148:1875953111483264:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048795.905358:0:20148:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff959c3ef38c00/0x133f221c08777482 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048795.909383:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048795.909530:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097765248 00000100:00100000:1.0:1789048795.909541:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097765248 00010000:00010000:1.0:1789048795.909594:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959b07ba0000/0x133f221c08777451 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29b70 expref: 13 pid: 17117 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048795.909636:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:1.0:1789048795.909647:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04cb9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d991937-03b3-45a3-961b-b41aa0369386+13:2393:x1875953097765248:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048795.909662:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048795.909667:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959b07ba0000/0x133f221c08777451 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29b70 expref: 13 pid: 17117 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048795.909680:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959b07ba0000/0x133f221c08777451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29b70 expref: 13 pid: 17117 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048795.909699:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b07ba0000/0x133f221c08777451 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29b70 expref: 13 pid: 17117 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048795.909716:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048795.909779:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04cb9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d991937-03b3-45a3-961b-b41aa0369386+12:2393:x1875953097765248:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 133us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048795.909803:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:2.0:1789048795.913576:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048795.913695:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097765376 00000100:00100000:0.0:1789048795.913706:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097765376 00010000:00010000:0.0:1789048795.913747:0:17108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c07060e00/0x133f221c08777412 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29b00 expref: 12 pid: 17115 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048795.913790:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:0.0:1789048795.913801:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d991937-03b3-45a3-961b-b41aa0369386+12:2394:x1875953097765376:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048795.913817:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048795.913823:0:17108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c07060e00/0x133f221c08777412 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29b00 expref: 12 pid: 17115 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.913835:0:17108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c07060e00/0x133f221c08777412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29b00 expref: 12 pid: 17115 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.913869:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c07060e00/0x133f221c08777412 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29b00 expref: 12 pid: 17115 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.913889:0:17108:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959c3ef38c00/0x133f221c08777482 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.913897:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef38c00/0x133f221c08777482 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.913913:0:17108:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef38c00/0x133f221c08777482 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.913921:0:17108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef38c00/0x133f221c08777482 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.913928:0:17108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff959c3ef38c00/0x133f221c08777482 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.913935:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff959c3ef38c00/0x133f221c08777482 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.913942:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38c00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048795.913946:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff959c3ef38c00/0x133f221c08777482 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.913955:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff959c3ef38c00/0x133f221c08777482 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.913978:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff959c3ef38c00/0x133f221c08777482 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048795.914001:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048795.914050:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d991937-03b3-45a3-961b-b41aa0369386+11:2394:x1875953097765376:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 250us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048795.914057:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00010000:00010000:3.0:1789048795.916076:0:20148:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff959c3ef38c00/0x133f221c08777482 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048795.916105:0:20148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff959c3ef38c00/0x133f221c08777482 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048795.916113:0:20148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef38c00/0x133f221c08777482 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048796.765677:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789048797.405903:0:17119:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789048797.405912:0:17119:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c3fb95000 from 13 10000000:01000000:1.0:1789048797.405918:0:17119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789048797.405966:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060200/0x133f221c08777489 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048797.405978:0:17119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c07060200/0x133f221c08777489 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048797.405991:0:17119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c07060200/0x133f221c08777489 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048797.406018:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111484416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789048797.406087:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048797.406129:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2a562a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789048797.408619:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111484416 00000100:00100000:3.0:1789048797.408633:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111484416 00000100:00100000:3.0:1789048797.408715:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789048797.408726:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+20:17119:x1875953111484416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048797.408745:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048797.408767:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef3c400/0x133f221c08777490 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777489 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048797.408796:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3c400/0x133f221c08777490 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777489 expref: 21 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048797.408806:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef3c400/0x133f221c08777490 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777489 expref: 21 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048797.408815:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3c400, rc 0) 00000100:00100000:3.0:1789048797.408885:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:17119:x1875953111484416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (2798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048797.408892:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789048797.409110:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111484416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048797.409129:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c07060200/0x133f221c08777489 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777490 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048797.409139:0:17119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c07060200/0x133f221c08777489 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777490 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048797.409235:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111484544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048797.409287:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048797.409330:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2a562a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789048797.409481:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111484544 00000100:00100000:0.0:1789048797.409487:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111484544 00000100:00100000:0.0:1789048797.409513:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789048797.409519:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:17119:x1875953111484544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048797.409638:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:17119:x1875953111484544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048797.409645:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789048797.409676:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111484544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048797.409713:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08884000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111484672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789048797.409750:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048797.409769:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c414bee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789048797.409779:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111484672 00000100:00100000:0.0:1789048797.409782:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111484672 00000100:00100000:0.0:1789048797.409797:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789048797.409802:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:17119:x1875953111484672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789048797.409877:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:17119:x1875953111484672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048797.409883:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789048797.409915:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08884000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111484672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789048797.410520:0:20188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789048797.410578:0:17119:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789048797.410607:0:17119:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789048797.410614:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060200/0x133f221c08777489 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777490 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048797.410624:0:17119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c07060200/0x133f221c08777489 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777490 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048797.410633:0:17119:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789048797.410636:0:17119:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959b081c1800 from 13 10000000:01000000:0.0:1789048797.410639:0:17119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789048797.410661:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08777497 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048797.410669:0:17119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08777497 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048797.410678:0:17119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08777497 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048797.410692:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08884000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111484800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789048797.410721:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048797.410741:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c414be480 going to sleep for 11 seconds 00000100:00100000:0.0:1789048797.410752:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111484800 00000100:00100000:0.0:1789048797.410756:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111484800 00000100:00100000:0.0:1789048797.410774:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789048797.410780:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:17119:x1875953111484800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789048797.410788:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048797.410797:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef39800/0x133f221c0877749e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777497 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048797.410825:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef39800/0x133f221c0877749e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777497 expref: 22 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048797.410834:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef39800/0x133f221c0877749e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777497 expref: 22 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048797.410844:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39800, rc 0) 00000100:00100000:0.0:1789048797.410872:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+22:17119:x1875953111484800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048797.410878:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789048797.410908:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08884000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111484800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789048797.410919:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08777497 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c0877749e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048797.410927:0:17119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08777497 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c0877749e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048797.410964:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08884000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111484928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048797.410988:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048797.411000:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c414be480 going to sleep for 11 seconds 00000100:00100000:0.0:1789048797.411009:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111484928 00000100:00100000:0.0:1789048797.411012:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111484928 00000100:00100000:0.0:1789048797.411027:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789048797.411033:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+22:17119:x1875953111484928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048797.411103:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+22:17119:x1875953111484928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048797.411117:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789048797.411146:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08884000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111484928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048797.411167:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08884000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111485056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789048797.411198:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048797.411209:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c42900 going to sleep for 11 seconds 00000100:00100000:0.0:1789048797.411219:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111485056 00000100:00100000:0.0:1789048797.411222:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111485056 00000100:00100000:0.0:1789048797.411235:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789048797.411258:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+22:17119:x1875953111485056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789048797.411320:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+22:17119:x1875953111485056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048797.411327:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789048797.411390:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08884000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111485056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789048797.421421:0:20189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789048797.432010:0:17119:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789048797.432051:0:17119:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789048797.432065:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08777497 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c0877749e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048797.432079:0:17119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08777497 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c0877749e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048797.432090:0:17119:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789048797.432093:0:17119:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c08aff800 from 13 10000000:01000000:0.0:1789048797.432106:0:17119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789048797.432153:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c087774a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048797.432176:0:17119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c087774a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048797.432188:0:17119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c087774a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048797.432213:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08884000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111485184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789048797.432299:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048797.432367:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c42900 going to sleep for 11 seconds 00000100:00100000:2.0:1789048797.433195:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111485184 00000100:00100000:2.0:1789048797.433204:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111485184 00000100:00100000:2.0:1789048797.433272:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789048797.433282:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+22:17119:x1875953111485184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048797.433316:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048797.433357:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba1a00/0x133f221c087774ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087774a5 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048797.433394:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba1a00/0x133f221c087774ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087774a5 expref: 23 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048797.433406:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba1a00/0x133f221c087774ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087774a5 expref: 23 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048797.433415:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1a00, rc 0) 00000100:00100000:0.0:1789048797.435296:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:17119:x1875953111485184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2007us (2988us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048797.435308:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789048797.439693:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08884000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111485184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048797.439729:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c087774a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087774ac expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048797.439765:0:17119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c087774a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087774ac expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048797.439864:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111485312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048797.439927:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048797.439974:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c37fc0300 going to sleep for 11 seconds 00000100:00100000:2.0:1789048797.440025:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111485312 00000100:00100000:2.0:1789048797.440032:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111485312 00000100:00100000:2.0:1789048797.440085:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789048797.440094:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:17119:x1875953111485312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048797.440220:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:17119:x1875953111485312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048797.440228:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789048797.440315:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111485312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048797.440378:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111485440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048797.440417:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048797.440430:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789048797.441376:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111485440 00000100:00100000:3.0:1789048797.441389:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111485440 00000100:00100000:3.0:1789048797.441444:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789048797.441455:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:17119:x1875953111485440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789048797.441606:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:17119:x1875953111485440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048797.441613:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789048797.441907:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111485440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789048797.442872:0:20191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789048797.445182:0:17119:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789048797.445219:0:17119:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789048797.445231:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c087774a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087774ac expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048797.445256:0:17119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c087774a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087774ac expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048797.445267:0:17119:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789048797.445270:0:17119:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c04ca4000 from 13 10000000:01000000:3.0:1789048797.445273:0:17119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789048797.445461:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087774b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048797.445472:0:17119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087774b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048797.445493:0:17119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087774b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048797.445519:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111485568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789048797.445585:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048797.445624:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c064cba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789048797.445684:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111485568 00000100:00100000:2.0:1789048797.445692:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111485568 00000100:00100000:2.0:1789048797.445749:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789048797.445757:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:17119:x1875953111485568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048797.445771:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048797.445784:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba1e00/0x133f221c087774ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087774b3 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048797.445806:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba1e00/0x133f221c087774ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087774b3 expref: 24 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048797.445816:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba1e00/0x133f221c087774ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087774b3 expref: 24 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048797.445824:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1e00, rc 0) 00000100:00100000:2.0:1789048797.445862:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:17119:x1875953111485568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048797.445869:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789048797.445946:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111485568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048797.445963:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087774b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087774ba expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048797.445972:0:17119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087774b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087774ba expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048797.446026:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111485696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048797.446052:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048797.446080:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c064cba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789048797.446119:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111485696 00000100:00100000:2.0:1789048797.446124:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111485696 00000100:00100000:2.0:1789048797.446153:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789048797.446160:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:17119:x1875953111485696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048797.446275:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:17119:x1875953111485696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048797.446281:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789048797.446495:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111485696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048797.446522:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111485824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048797.446561:0:17119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048797.446580:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88300 going to sleep for 11 seconds 00000100:00100000:2.0:1789048797.446597:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111485824 00000100:00100000:2.0:1789048797.446602:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111485824 00000100:00100000:2.0:1789048797.446623:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789048797.446629:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:17119:x1875953111485824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048797.446705:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:17119:x1875953111485824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048797.446712:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789048797.446751:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:17119:1875953111485824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789048797.450542:0:20192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789048797.450624:0:17119:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789048797.450648:0:17119:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789048797.450659:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087774b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087774ba expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048797.450673:0:17119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087774b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087774ba expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048797.509620:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048797.509690:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097765504 00000100:00100000:0.0:1789048797.509700:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097765504 00000100:00100000:0.0:1789048797.509753:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 162 00000100:00100000:0.0:1789048797.509763:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+11:14903:x1875953097765504:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789048797.509780:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048797.509799:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef38000/0x133f221c087774c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29ba8 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048797.509829:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef38000/0x133f221c087774c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29ba8 expref: 12 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048797.509840:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef38000/0x133f221c087774c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29ba8 expref: 12 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048797.509851:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38000, rc 0) 00000100:00100000:0.0:1789048797.509921:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+12:14903:x1875953097765504:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 159us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048797.509928:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 162 00000100:00100000:2.0:1789048797.512703:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048797.512797:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097765632 00000100:00100000:3.0:1789048797.512810:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097765632 00000100:00100000:3.0:1789048797.512897:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 163 00000100:00100000:3.0:1789048797.512908:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+12:14903:x1875953097765632:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048797.513184:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+12:14903:x1875953097765632:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 277us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048797.513193:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 163 00000100:00100000:0.0:1789048797.536357:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048797.536392:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097765760 00000100:00100000:2.0:1789048797.536402:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097765760 00000100:00100000:2.0:1789048797.536460:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 164 00000100:00100000:2.0:1789048797.536471:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+12:14903:x1875953097765760:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048797.536621:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+12:14903:x1875953097765760:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 151us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048797.536629:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 164 00000100:00100000:3.0:1789048797.564269:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048797.564493:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097765888 00000100:00100000:1.0:1789048797.564511:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097765888 00000100:00100000:1.0:1789048797.564567:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 165 00000100:00100000:1.0:1789048797.564577:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+12:14903:x1875953097765888:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048797.564596:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048797.564614:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c07061800/0x133f221c087774c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29baf expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048797.564645:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c07061800/0x133f221c087774c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29baf expref: 13 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048797.564658:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c07061800/0x133f221c087774c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29baf expref: 13 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048797.564668:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07061800, rc 0) 00000100:00100000:1.0:1789048797.564722:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+13:14903:x1875953097765888:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 146us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048797.564728:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 165 00000100:00100000:3.0:1789048797.568876:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048797.568987:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097766016 00000100:00100000:1.0:1789048797.568996:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097766016 00000100:00100000:1.0:1789048797.569058:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 166 00000100:00100000:1.0:1789048797.569069:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c489050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+13:14903:x1875953097766016:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048797.569214:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c489050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+13:14903:x1875953097766016:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 147us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048797.569222:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 166 00000100:00100000:1.0:1789048797.591461:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048797.591635:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097766144 00000100:00100000:0.0:1789048797.591646:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097766144 00000100:00100000:0.0:1789048797.591823:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 167 00000100:00100000:0.0:1789048797.591834:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+13:14903:x1875953097766144:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789048797.591970:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+13:14903:x1875953097766144:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 137us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048797.591979:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 167 00010000:00010000:2.0:1789048797.797440:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048798.181686:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111485952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048798.181763:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048798.181979:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111485952 00000100:00100000:1.0:1789048798.181987:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111485952 00000100:00100000:1.0:1789048798.182065:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789048798.182077:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111485952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789048798.182109:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1789048798.182172:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789048798.187444:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111485952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5358us (5669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048798.187461:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789048798.187909:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111485952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048798.270834:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048798.270874:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048798.270902:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048798.270939:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097766784 00000100:00100000:3.0:1789048798.270948:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097766784 00000100:00100000:3.0:1789048798.271010:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:3.0:1789048798.271021:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2391:x1875953097766784:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048798.271102:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2391:x1875953097766784:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 83us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048798.271110:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00080000:3.0:1789048798.271132:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789048798.271516:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097766272 00000100:00100000:1.0:1789048798.271521:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097766272 00000100:00100000:1.0:1789048798.271594:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 168 00000100:00100000:1.0:1789048798.271602:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+13:2391:x1875953097766272:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048798.271643:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+13:2391:x1875953097766272:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 42us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048798.271649:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 168 00000100:00100000:2.0:1789048798.271846:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097766528 00000100:00100000:2.0:1789048798.271851:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097766528 00000100:00100000:2.0:1789048798.271907:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:2.0:1789048798.271915:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2391:x1875953097766528:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048798.271953:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2391:x1875953097766528:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 40us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048798.271959:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00080000:0.0:1789048798.272022:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048798.278738:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048798.278788:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048798.278821:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048798.278847:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048798.278874:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048798.278901:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048798.278932:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097767296 00000100:00100000:3.0:1789048798.278948:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097767296 00000100:00100000:3.0:1789048798.279009:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097766656 00000100:00100000:3.0:1789048798.279012:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097766656 00000100:00100000:3.0:1789048798.279026:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097767168 00000100:00100000:3.0:1789048798.279028:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097767168 00000100:00100000:3.0:1789048798.279042:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:3.0:1789048798.279052:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2391:x1875953097767296:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048798.279140:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2391:x1875953097767296:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 89us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048798.279148:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:3.0:1789048798.279166:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:3.0:1789048798.279173:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2391:x1875953097766656:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048798.279198:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2391:x1875953097766656:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048798.279204:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:3.0:1789048798.279215:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:3.0:1789048798.279221:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2391:x1875953097767168:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048798.279255:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2391:x1875953097767168:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 34us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048798.279262:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:3.0:1789048798.279290:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097767040 00000100:00100000:3.0:1789048798.279293:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097767040 00000100:00100000:3.0:1789048798.279321:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097766400 00000100:00100000:3.0:1789048798.279324:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097766400 00000100:00100000:3.0:1789048798.279374:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097766912 00000100:00100000:3.0:1789048798.279377:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097766912 00000100:00100000:3.0:1789048798.279393:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:3.0:1789048798.279399:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2391:x1875953097767040:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048798.279427:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2391:x1875953097767040:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 28us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048798.279433:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:3.0:1789048798.279444:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:3.0:1789048798.279459:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:2391:x1875953097766400:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048798.279486:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:2391:x1875953097766400:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 28us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048798.279492:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:3.0:1789048798.279504:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:3.0:1789048798.279510:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:2391:x1875953097766912:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048798.279533:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:2391:x1875953097766912:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 23us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048798.279538:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00080000:3.0:1789048798.279674:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048798.279678:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789048798.279680:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789048798.279682:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789048798.814207:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048799.197814:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789048799.199893:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111486080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789048799.199987:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048799.200279:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111486080 00000100:00100000:2.0:1789048799.200289:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111486080 00000100:00100000:2.0:1789048799.200382:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789048799.200393:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111486080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789048799.200417:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789048799.200475:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111486080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048799.200482:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789048799.200661:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789048799.200889:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111486080:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789048799.837793:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048800.222488:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111486208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048800.222563:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048800.222818:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111486208 00000100:00100000:0.0:1789048800.222827:0:18100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111486208 00000100:00100000:0.0:1789048800.222885:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789048800.222895:0:18100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111486208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789048800.222929:0:18100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789048800.222999:0:18100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111486208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048800.223006:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789048800.223094:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111486208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789048800.334315:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048800.334643:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097767424 00000100:00100000:2.0:1789048800.334654:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097767424 00000100:00100000:2.0:1789048800.334734:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:2.0:1789048800.334746:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:15573:x1875953097767424:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789048800.334768:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048800.334791:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087774cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29bb6 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.335027:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087774d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.335059:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087774d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.335074:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087774d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.335090:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087774dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.335097:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087774dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.335103:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087774dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.335186:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c087774e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.335194:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c087774e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.335201:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c087774e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048800.335246:0:17122:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789048800.335250:0:17122:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789048800.335289:0:17122:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c087774e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.335300:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087774d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789048800.335671:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789048800.336034:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087774d6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.336041:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087774d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.336047:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048800.336051:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087774d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.336059:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087774d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.336071:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfc100) 00010000:00010000:2.0:1789048800.336074:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048800.336079:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087774d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.336085:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c087774d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.336101:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087774dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.336107:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087774dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.336112:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087774dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.336117:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048800.336125:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087774dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.336130:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087774dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.336138:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff959c05322a00) 00010000:00010000:2.0:1789048800.336140:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048800.336143:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087774dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.336149:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087774dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.336186:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087774cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bb6 expref: 8 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.336200:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c087774e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bb6 expref: 7 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.336207:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff959c05322d00) 00010000:00010000:2.0:1789048800.336223:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789048800.336227:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0200, rc 0) 00000100:00100000:2.0:1789048800.336297:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+7:15573:x1875953097767424:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 1553us (2000us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048800.337017:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:3.0:1789048800.341927:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048800.342084:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097767552 00000100:00100000:0.0:1789048800.342095:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097767552 00000100:00100000:0.0:1789048800.342198:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:0.0:1789048800.342222:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+7:15573:x1875953097767552:12345-192.168.202.16@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789048800.342358:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+7:15573:x1875953097767552:12345-192.168.202.16@tcp:900:lhsmtool_posix.0 Request processed in 125us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048800.342385:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:3.0:1789048800.348478:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048800.348815:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097767808 00000100:00100000:0.0:1789048800.348826:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097767808 00000100:00100000:0.0:1789048800.348887:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:0.0:1789048800.348897:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+7:15573:x1875953097767808:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789048800.348918:0:19099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048800.348941:0:19099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c087774eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29bbd expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.349159:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087774f2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.349175:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087774f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.349188:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087774f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.349514:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087774f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.349524:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087774f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.349531:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087774f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.349709:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08777500 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.349734:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08777500 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.349742:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08777500 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048800.349753:0:19099:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789048800.349896:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087774f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.349904:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087774f2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.349910:0:19099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087774f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.349916:0:19099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048800.349920:0:19099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087774f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.349927:0:19099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087774f2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.349939:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff959c05322d00) 00010000:00010000:0.0:1789048800.349942:0:19099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048800.349947:0:19099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087774f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.349954:0:19099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087774f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.349966:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087774f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.349978:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087774f9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.349984:0:19099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087774f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.349990:0:19099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048800.349993:0:19099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087774f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.350000:0:19099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087774f9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.350007:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff959c3ef1e200) 00010000:00010000:0.0:1789048800.350010:0:19099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048800.350013:0:19099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087774f9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.350019:0:19099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c087774f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.351726:0:19099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c087774eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bbd expref: 10 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.351755:0:19099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08777500 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bbd expref: 9 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.351764:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff959c3ef1e700) 00010000:00010000:0.0:1789048800.351767:0:19099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048800.351780:0:19099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39200, rc 0) 00000100:00100000:0.0:1789048800.351863:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+9:15573:x1875953097767808:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 2966us (3393us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789048800.351871:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:3.0:1789048800.355895:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048800.357143:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097767936 00000100:00100000:0.0:1789048800.357155:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097767936 00000100:00100000:0.0:1789048800.357388:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:0.0:1789048800.357400:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+9:15573:x1875953097767936:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789048800.361449:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+9:15573:x1875953097767936:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 Request processed in 4039us (5550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048800.361464:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:3.0:1789048800.363679:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048800.363777:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097768064 00000100:00100000:1.0:1789048800.363787:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097768064 00000100:00100000:1.0:1789048800.363860:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:1.0:1789048800.363871:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:15573:x1875953097768064:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1789048800.367364:0:17123:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3445us 00000100:00080000:3.0:1789048800.367736:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789048800.416889:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:15573:x1875953097768064:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 Request processed in 53007us (53217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048800.416903:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:1.0:1789048800.444028:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048800.446165:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097768192 00000100:00100000:2.0:1789048800.446182:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097768192 00000100:00100000:2.0:1789048800.446311:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:2.0:1789048800.446322:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+9:15579:x1875953097768192:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048800.446396:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048800.446420:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877750e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29bc4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446487:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777515 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446502:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777515 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446514:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777515 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446529:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c0877751c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446535:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c0877751c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446542:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c0877751c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446580:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777515 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446588:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777515 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446595:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777515 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446602:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048800.446613:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777515 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446621:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777515 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446633:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfc100) 00010000:00010000:2.0:1789048800.446637:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048800.446642:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777515 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446649:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777515 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446666:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c0877751c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446672:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c0877751c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446679:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c0877751c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446684:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048800.446687:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c0877751c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446693:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c0877751c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446701:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff959c05322a00) 00010000:00010000:2.0:1789048800.446703:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048800.446713:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c0877751c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446719:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c0877751c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446761:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877750e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bc4 expref: 10 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446771:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfc100) 00010000:00010000:2.0:1789048800.446774:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048800.446778:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877750e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bc4 expref: 10 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.446788:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0800, rc 0) 00000100:00100000:2.0:1789048800.446870:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+9:15579:x1875953097768192:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 549us (2851us total) trans 0 rc 301/301 00000100:00100000:2.0:1789048800.446876:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:3.0:1789048800.455753:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048800.455904:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097768320 00000100:00100000:2.0:1789048800.455921:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097768320 00000100:00100000:2.0:1789048800.456012:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:2.0:1789048800.456022:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+9:15579:x1875953097768320:12345-192.168.202.16@tcp:700:lfs.0 00000100:00100000:2.0:1789048800.456177:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+9:15579:x1875953097768320:12345-192.168.202.16@tcp:700:lfs.0 Request processed in 156us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048800.456186:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:3.0:1789048800.463645:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048800.463767:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097768576 00000100:00100000:0.0:1789048800.463782:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097768576 00000100:00100000:0.0:1789048800.463866:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:0.0:1789048800.463879:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+9:15579:x1875953097768576:12345-192.168.202.16@tcp:36:lfs.0 00010000:00010000:0.0:1789048800.463970:0:19099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048800.464009:0:19099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ce00/0x133f221c0877743c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29b31 expref: 9 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.464034:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfc100) 00010000:00010000:0.0:1789048800.464040:0:19099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789048800.464138:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08777523 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.464155:0:19099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877747b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29ba1 expref: 5 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.464189:0:19099:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08777523 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.464250:0:19099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877747b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29ba1 expref: 5 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.464269:0:19099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877747b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29ba1 expref: 5 pid: 17123 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048800.464288:0:19099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08884a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19099:1875953111486336:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789048800.465381:0:19099:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c42240 going to sleep for 11 seconds 00000100:00100000:2.0:1789048800.471454:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048800.471633:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097768704 00000100:00100000:3.0:1789048800.471646:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097768704 00000100:00100000:1.0:1789048800.471849:0:19099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08884a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19099:1875953111486336:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789048800.471884:0:19099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08777523 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.472019:0:17109:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877747b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29ba1 expref: 6 pid: 17123 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048800.472142:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:3.0:1789048800.472153:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:2394:x1875953097768704:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048800.472172:0:17109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048800.472180:0:17109:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877747b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29ba1 expref: 6 pid: 17123 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.472194:0:17109:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877747b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29ba1 expref: 6 pid: 17123 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.472232:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877747b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29ba1 expref: 6 pid: 17123 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.472251:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfc100) 00000100:00080000:2.0:1789048800.472354:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789048800.472576:0:17109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08777523 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.472589:0:17109:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08777523 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.472598:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08777523 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.472628:0:17109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048800.472698:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2394:x1875953097768704:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 546us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048800.472707:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00010000:00010000:1.0:1789048800.472945:0:19099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08777523 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048800.472954:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08777523 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048800.472986:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c0877752a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048800.472997:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c0877752a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048800.473005:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c0877752a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.477308:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777531 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.477365:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777531 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.477380:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777531 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789048800.477418:0:19099:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000005b2c1ee0 reply state 00000000b4c20fe8 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777531 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.477430:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777531 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.477439:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff959c3ef1e200) 00010000:00010000:0.0:1789048800.477442:0:19099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789048800.477457:0:19099:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789048800.477465:0:19099:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789048800.477476:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08777523 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.477484:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08777523 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.477491:0:19099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08777523 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.477497:0:19099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048800.477502:0:19099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08777523 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.477510:0:19099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08777523 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.477521:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfc100) 00010000:00010000:0.0:1789048800.477524:0:19099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048800.477528:0:19099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08777523 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.477535:0:19099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c08777523 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789048800.477632:0:19099:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000005b2c1ee0 reply state 00000000b4c20fe8 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c0877752a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.477643:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c0877752a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.477649:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff959c3ef1fb00) 00010000:00010000:0.0:1789048800.477657:0:19099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789048800.477660:0:19099:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789048800.477777:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+10:15579:x1875953097768576:12345-192.168.202.16@tcp:36:lfs.0 Request processed in 13897us (14285us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789048800.477786:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:2.0:1789048800.640600:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048800.640758:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097768832 00000100:00100000:3.0:1789048800.640774:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097768832 00000100:00100000:3.0:1789048800.640847:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:3.0:1789048800.640857:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+10:15587:x1875953097768832:12345-192.168.202.16@tcp:101:lctl.0 00010000:00010000:3.0:1789048800.640879:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048800.640902:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d200/0x133f221c08777538 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29bcb expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.640971:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c200/0x133f221c0877753f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.640985:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c200/0x133f221c0877753f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.640998:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c200/0x133f221c0877753f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048800.642200:0:17122:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789048800.642218:0:17122:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789048800.642442:0:17122:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c200/0x133f221c0877753f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.642666:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d200/0x133f221c08777538 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bcb expref: 12 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.642697:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c200/0x133f221c0877753f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bcb expref: 11 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.642707:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfcd00) 00010000:00010000:3.0:1789048800.642711:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789048800.642715:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3c200, rc 0) 00000100:00100000:3.0:1789048800.642819:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+11:15587:x1875953097768832:12345-192.168.202.16@tcp:101:lctl.0 Request processed in 1962us (2226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048800.642830:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:1.0:1789048800.702133:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048800.704880:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097768960 00000100:00100000:2.0:1789048800.704896:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097768960 00000100:00100000:2.0:1789048800.707220:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:2.0:1789048800.707587:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:15588:x1875953097768960:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048800.707609:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048800.707632:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777546 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29bd2 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.707707:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c0877754d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.707720:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c0877754d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.707731:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c0877754d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048800.707776:0:17123:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789048800.707780:0:17123:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789048800.707802:0:17123:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c0877754d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.707825:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777546 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bd2 expref: 7 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.707846:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c0877754d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bd2 expref: 6 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.707855:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfcd00) 00010000:00010000:2.0:1789048800.707858:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789048800.707875:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0600, rc 0) 00000100:00100000:2.0:1789048800.708025:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:15588:x1875953097768960:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 452us (5902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048800.710138:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:2.0:1789048800.717460:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048800.717575:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097769088 00000100:00100000:3.0:1789048800.717586:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097769088 00000100:00100000:3.0:1789048800.717647:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:3.0:1789048800.717657:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:15588:x1875953097769088:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789048800.717955:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048800.717980:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d200/0x133f221c08777554 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29bd9 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718043:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c600/0x133f221c0877755b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718057:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c600/0x133f221c0877755b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718068:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c600/0x133f221c0877755b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718077:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777562 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718084:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718091:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718170:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08777569 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718195:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08777569 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718203:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08777569 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048800.718481:0:17122:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789048800.718486:0:17122:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789048800.718509:0:17122:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08777569 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718522:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c600/0x133f221c0877755b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718529:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c600/0x133f221c0877755b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718535:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c600/0x133f221c0877755b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718542:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048800.718546:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c600/0x133f221c0877755b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718622:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c600/0x133f221c0877755b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718635:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfcd00) 00010000:00010000:3.0:1789048800.718638:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048800.718642:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c600/0x133f221c0877755b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718659:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c600/0x133f221c0877755b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718795:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718799:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777562 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718803:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777562 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718806:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048800.718808:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777562 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718811:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777562 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718816:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff959c3ef1fb00) 00010000:00010000:3.0:1789048800.718818:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048800.718820:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777562 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718824:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777562 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718844:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d200/0x133f221c08777554 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bd9 expref: 8 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718861:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08777569 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bd9 expref: 7 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048800.718866:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff959c3ef1e200) 00010000:00010000:3.0:1789048800.718867:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789048800.718869:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3ca00, rc 0) 00000100:00100000:3.0:1789048800.718962:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+7:15588:x1875953097769088:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1307us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048800.718968:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:3.0:1789048800.726469:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048800.728059:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097769216 00000100:00100000:2.0:1789048800.728074:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097769216 00000100:00100000:2.0:1789048800.728151:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:2.0:1789048800.728161:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:15588:x1875953097769216:12345-192.168.202.16@tcp:900:lfs.0 00000100:00100000:2.0:1789048800.728275:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:15588:x1875953097769216:12345-192.168.202.16@tcp:900:lfs.0 Request processed in 115us (1815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048800.728283:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00080000:3.0:1789048800.728786:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048800.733842:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789048800.733865:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07b12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111486464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048800.734247:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111486720:0@lo:400:kworker.0 00000100:00100000:0.0:1789048800.734281:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048800.734316:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111487232:0@lo:400:kworker.0 00000100:00100000:0.0:1789048800.734364:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048800.734383:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111487744:0@lo:400:kworker.0 00000100:00100000:0.0:1789048800.734407:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048800.734426:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789048800.734431:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111486848:0@lo:400:kworker.0 00000100:00100000:0.0:1789048800.734453:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048800.734470:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111487360:0@lo:400:kworker.0 00000100:00100000:0.0:1789048800.734488:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048800.734503:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111487872:0@lo:400:kworker.0 00000100:00100000:0.0:1789048800.734523:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048800.734562:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111486720 00000100:00100000:0.0:1789048800.734569:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111486720 00000100:00100000:0.0:1789048800.734611:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111487232 00000100:00100000:0.0:1789048800.734614:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111487232 00000100:00100000:0.0:1789048800.734633:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789048800.734641:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111486720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048800.734817:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111486720:12345-0@lo:400:kworker.0 Request processed in 176us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048800.734842:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789048800.734861:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789048800.734866:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111487232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048800.734896:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111487232:12345-0@lo:400:kworker.0 Request processed in 30us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048800.734901:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789048800.734919:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111486848 00000100:00100000:0.0:1789048800.734923:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111486848 00000100:00100000:2.0:1789048800.735074:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111486976:0@lo:400:kworker.0 00000100:00100000:2.0:1789048800.735104:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048800.735126:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111487488:0@lo:400:kworker.0 00000100:00100000:2.0:1789048800.735146:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048800.735161:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111488000:0@lo:400:kworker.0 00000100:00100000:2.0:1789048800.735180:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048800.735198:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789048800.735216:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111486592:0@lo:400:kworker.0 00000100:00100000:2.0:1789048800.735244:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048800.735269:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111487104:0@lo:400:kworker.0 00000100:00100000:2.0:1789048800.735287:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048800.735304:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111487616:0@lo:400:kworker.0 00000100:00100000:2.0:1789048800.735324:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048800.735369:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111488128:0@lo:400:kworker.0 00000100:00100000:2.0:1789048800.735391:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048800.735413:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111487360 00000100:00100000:2.0:1789048800.735416:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111487360 00000100:00100000:2.0:1789048800.735439:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111486976 00000100:00100000:2.0:1789048800.735442:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111486976 00000100:00100000:1.0:1789048800.735525:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789048800.735535:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111488256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048800.735581:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048800.735610:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111486592 00000100:00100000:1.0:1789048800.735614:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111486592 00000100:00100000:1.0:1789048800.735642:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789048800.735658:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3620:x1875953111486592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048800.735711:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3620:x1875953111486592:12345-0@lo:400:kworker.0 Request processed in 55us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048800.735717:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789048800.735780:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2a41bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111488384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789048800.735807:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111488256 00000100:00100000:1.0:1789048800.735810:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111488256 00000100:00100000:1.0:1789048800.735827:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789048800.735833:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111488256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789048800.735857:0:17128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789048800.735892:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111488256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048800.735897:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789048800.736058:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111487488 00000100:00100000:0.0:1789048800.736063:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111487488 00000100:00100000:1.0:1789048800.736087:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111486592:0@lo:400:kworker.0 00000100:00100000:1.0:1789048800.736141:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789048800.736149:0:18630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111487360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048800.736198:0:18630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111487360:12345-0@lo:400:kworker.0 Request processed in 49us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048800.736204:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789048800.736232:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789048800.736239:0:18630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111486848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048800.736267:0:18630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111486848:12345-0@lo:400:kworker.0 Request processed in 28us (1812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048800.736272:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789048800.736305:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111487744 00000100:00100000:1.0:1789048800.736309:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111487744 00000100:00100000:3.0:1789048800.736360:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048800.740887:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789048800.740905:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111486976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048800.741025:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111486976:12345-0@lo:400:kworker.0 Request processed in 126us (5919us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048800.741033:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789048800.741076:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111487872 00000100:00100000:2.0:1789048800.741084:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111487872 00000100:00100000:2.0:1789048800.741109:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111488000 00000100:00100000:2.0:1789048800.741112:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111488000 00000100:00100000:2.0:1789048800.741126:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111487104 00000100:00100000:2.0:1789048800.741129:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111487104 00000100:00100000:2.0:1789048800.741142:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111487616 00000100:00100000:2.0:1789048800.741144:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111487616 00000100:00100000:2.0:1789048800.741154:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111488128 00000100:00100000:2.0:1789048800.741156:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111488128 00000100:00100000:2.0:1789048800.741188:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789048800.741195:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111487872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048800.741245:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111487872:12345-0@lo:400:kworker.0 Request processed in 51us (6722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048800.741251:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789048800.743097:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789048800.743117:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111488000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048800.743539:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111488000:12345-0@lo:400:kworker.0 Request processed in 429us (8355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048800.743573:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789048800.743589:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789048800.743597:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111487104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048800.743631:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111487104:12345-0@lo:400:kworker.0 Request processed in 35us (8343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048800.743637:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789048800.743650:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789048800.743657:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111487616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048800.743839:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111487616:12345-0@lo:400:kworker.0 Request processed in 183us (8513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048800.743846:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789048800.743860:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789048800.743868:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111488128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048800.743897:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111488128:12345-0@lo:400:kworker.0 Request processed in 32us (8505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048800.743903:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789048800.743931:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111486464 00000100:00100000:2.0:1789048800.744098:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111486464 00000100:00100000:2.0:1789048800.744158:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789048800.744544:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1875953111486464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789048800.744577:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789048800.744624:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1875953111486464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 460us (10693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048800.744631:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789048800.744689:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111487104:0@lo:400:kworker.0 00000100:00100000:2.0:1789048800.744715:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111487616:0@lo:400:kworker.0 00010000:00080000:2.0:1789048800.744728:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08886d80 x1875953111488128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048800.744739:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111488128:0@lo:400:kworker.0 00000100:00100000:2.0:1789048800.744749:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111486976:0@lo:400:kworker.0 00000100:00100000:2.0:1789048800.744759:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111488000:0@lo:400:kworker.0 00000100:00100000:2.0:1789048800.744818:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048800.744854:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111488256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789048800.744875:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111488384 00000100:00100000:2.0:1789048800.744879:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111488384 00000100:00100000:2.0:1789048800.744895:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789048800.744900:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111488384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789048800.744908:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789048800.744949:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111488384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048800.744955:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789048800.744979:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2a41bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111488384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048800.745018:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07b12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111486464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789048800.745067:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111486848:0@lo:400:kworker.0 00000100:00100000:2.0:1789048800.745080:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111487360:0@lo:400:kworker.0 00010000:00080000:2.0:1789048800.745091:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08887100 x1875953111487872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048800.745112:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111487872:0@lo:400:kworker.0 00000100:00100000:2.0:1789048800.745126:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111486720:0@lo:400:kworker.0 00000100:00100000:2.0:1789048800.745138:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111487232:0@lo:400:kworker.0 00000100:00100000:0.0:1789048800.749778:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789048800.749794:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111487488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048800.749905:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111487488:12345-0@lo:400:kworker.0 Request processed in 114us (14756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048800.749913:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789048800.749978:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111487488:0@lo:400:kworker.0 00000100:00100000:1.0:1789048800.753329:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789048800.753359:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111487744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048800.753454:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111487744:12345-0@lo:400:kworker.0 Request processed in 99us (19046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048800.753460:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789048800.763121:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111487744:0@lo:400:kworker.0 00000100:00080000:3.0:1789048800.773281:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789048800.773292:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048800.773296:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789048800.773298:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789048800.773502:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048800.773598:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097769472 00000100:00100000:2.0:1789048800.773609:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097769472 00000100:00100000:2.0:1789048800.773676:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:2.0:1789048800.773686:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+7:15588:x1875953097769472:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048800.773708:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048800.773730:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777570 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29be0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048800.773835:0:17123:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789048800.773961:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777570 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29be0 expref: 9 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.773976:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfcd00) 00010000:00010000:2.0:1789048800.773979:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789048800.773984:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777570 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29be0 expref: 9 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.774000:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0a00, rc 0) 00000100:00100000:2.0:1789048800.774067:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+8:15588:x1875953097769472:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 382us (570us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789048800.774075:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:1.0:1789048800.777487:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048800.778381:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097769728 00000100:00100000:0.0:1789048800.778393:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097769728 00000100:00100000:0.0:1789048800.778460:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:0.0:1789048800.778470:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a41aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e75ca1a9-3972-4d73-931e-9ff32f454dcc+8:15588:x1875953097769728:12345-192.168.202.16@tcp:36:lfs.0 00010000:00010000:0.0:1789048800.778523:0:19099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048800.778562:0:19099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3ca00/0x133f221c08777569 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bd9 expref: 8 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.778602:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff959c3ef1e200) 00010000:00010000:0.0:1789048800.778607:0:19099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789048800.778630:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877757e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.778643:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877757e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.778652:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877757e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789048800.778850:0:19099:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000ac88a785 reply state 00000000b8e6c93e transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877757e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.778862:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877757e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.778868:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff959c3ef1e200) 00010000:00010000:0.0:1789048800.778871:0:19099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1789048800.778873:0:19099:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789048800.778881:0:19099:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789048800.778958:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a41aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e75ca1a9-3972-4d73-931e-9ff32f454dcc+9:15588:x1875953097769728:12345-192.168.202.16@tcp:36:lfs.0 Request processed in 488us (1482us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789048800.778964:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:1.0:1789048800.794294:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048800.794545:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097769984 00000100:00100000:2.0:1789048800.794567:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097769984 00000100:00100000:2.0:1789048800.794633:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:2.0:1789048800.794644:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a41b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+9:15588:x1875953097769984:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789048800.794885:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a41b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+10:15588:x1875953097769984:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 242us (601us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789048800.794893:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:1.0:1789048800.811400:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048800.813794:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097770240 00000100:00100000:2.0:1789048800.813810:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097770240 00000100:00100000:2.0:1789048800.813896:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:2.0:1789048800.813908:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+10:15588:x1875953097770240:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048800.813932:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048800.813952:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777585 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29be7 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814028:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877758c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814043:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877758c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814056:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877758c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814068:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08777593 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814075:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08777593 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814102:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08777593 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048800.814251:0:17123:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789048800.814327:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877758c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814370:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877758c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814376:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877758c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814382:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048800.814386:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877758c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814392:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877758c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814404:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfcd00) 00010000:00010000:2.0:1789048800.814407:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048800.814412:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877758c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814418:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c0877758c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814434:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08777593 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814449:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08777593 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814456:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08777593 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814461:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048800.814464:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08777593 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814470:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08777593 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814478:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff959c3ef1fb00) 00010000:00010000:2.0:1789048800.814480:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048800.814483:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08777593 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814489:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08777593 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814524:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777585 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29be7 expref: 12 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814535:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfcd00) 00010000:00010000:2.0:1789048800.814537:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789048800.814541:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777585 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29be7 expref: 12 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.814561:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0a00, rc 0) 00000100:00100000:2.0:1789048800.814638:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+11:15588:x1875953097770240:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 732us (3248us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789048800.814646:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:3.0:1789048800.820409:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048800.820466:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097770368 00000100:00100000:0.0:1789048800.820476:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097770368 00000100:00100000:0.0:1789048800.820536:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:0.0:1789048800.820547:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e75ca1a9-3972-4d73-931e-9ff32f454dcc+11:15588:x1875953097770368:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789048800.820584:0:19099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048800.820620:0:19099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087775a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29bee expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.820727:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c087775a8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.820742:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c087775a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.820754:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c087775a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048800.820779:0:19099:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789048800.820783:0:19099:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789048800.820801:0:19099:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c087775a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.820826:0:19099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087775a1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bee expref: 13 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.820846:0:19099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c087775a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bee expref: 12 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.820854:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff959c3ef1e200) 00010000:00010000:0.0:1789048800.820857:0:19099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789048800.820860:0:19099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38a00, rc 0) 00000100:00100000:0.0:1789048800.820931:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e75ca1a9-3972-4d73-931e-9ff32f454dcc+12:15588:x1875953097770368:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 385us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048800.820938:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:1.0:1789048800.830012:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048800.830122:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097770496 00000100:00100000:2.0:1789048800.830133:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097770496 00000100:00100000:2.0:1789048800.830192:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:2.0:1789048800.830203:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a41b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+12:15588:x1875953097770496:12345-192.168.202.16@tcp:37:lfs.0 00000100:00100000:2.0:1789048800.835962:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a41b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+12:15588:x1875953097770496:12345-192.168.202.16@tcp:37:lfs.0 Request processed in 5004us (5202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048800.835976:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:3.0:1789048800.845896:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048800.847427:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097770752 00000100:00100000:1.0:1789048800.847441:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097770752 00000100:00100000:1.0:1789048800.847519:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:1.0:1789048800.847530:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41507c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+12:15588:x1875953097770752:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1789048800.848041:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41507c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+13:15588:x1875953097770752:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 510us (2150us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789048800.848051:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00010000:00010000:3.0:1789048800.862679:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048800.957034:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048800.958126:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097770880 00000100:00100000:2.0:1789048800.958139:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097770880 00000100:00100000:2.0:1789048800.958248:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:2.0:1789048800.958267:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a41b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+11:15594:x1875953097770880:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789048800.958288:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048800.958309:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087775af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29bf5 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958406:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087775b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958421:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087775b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958432:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087775b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958457:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087775bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958465:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087775bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958471:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087775bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958560:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c087775c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958569:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c087775c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958577:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c087775c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048800.958609:0:17123:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789048800.958612:0:17123:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789048800.958655:0:17123:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c087775c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958667:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087775b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958674:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087775b6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958680:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087775b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958695:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048800.958699:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087775b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958707:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087775b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958719:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfcd00) 00010000:00010000:2.0:1789048800.958722:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048800.958727:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087775b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958732:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087775b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958750:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087775bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958755:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087775bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958761:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087775bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958766:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048800.958768:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087775bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958774:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087775bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958790:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff959c3ef1fb00) 00010000:00010000:2.0:1789048800.958792:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048800.958796:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087775bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958802:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087775bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958828:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087775af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bf5 expref: 13 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958841:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c087775c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bf5 expref: 12 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.958848:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff959c3ef1e200) 00010000:00010000:2.0:1789048800.958850:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789048800.958853:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0e00, rc 0) 00000100:00100000:2.0:1789048800.958922:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a41b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+12:15594:x1875953097770880:12345-192.168.202.16@tcp:101:bash.0 Request processed in 657us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048800.958929:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:3.0:1789048800.962087:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048800.962177:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097771008 00000100:00100000:2.0:1789048800.962188:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097771008 00000100:00100000:2.0:1789048800.962269:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:2.0:1789048800.962280:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07b12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:15594:x1875953097771008:12345-192.168.202.16@tcp:900:bash.0 00000100:00100000:2.0:1789048800.962433:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07b12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:15594:x1875953097771008:12345-192.168.202.16@tcp:900:bash.0 Request processed in 155us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048800.962441:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:1.0:1789048800.974456:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048800.975644:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097771264 00000100:00100000:0.0:1789048800.975680:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097771264 00000100:00100000:0.0:1789048800.975825:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:0.0:1789048800.975837:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a41b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+12:15594:x1875953097771264:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048800.975859:0:19099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048800.975894:0:19099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087775cb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29bfc expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.976008:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087775d2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.976026:0:19099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c087775a8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bee expref: 12 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.976036:0:19099:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087775d2 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.976071:0:19099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c087775a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29bee expref: 12 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048800.976088:0:19099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c087775a8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29bee expref: 12 pid: 19099 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048800.976105:0:19099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08a06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19099:1875953111488512:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789048800.976219:0:19099:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c42e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789048800.984954:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048800.985688:0:19099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08a06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19099:1875953111488512:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048800.985729:0:19099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087775d2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048800.986741:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097771392 00000100:00100000:2.0:1789048800.986752:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097771392 00010000:00010000:2.0:1789048800.986795:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c087775a8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29bee expref: 13 pid: 19099 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048800.986829:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:2.0:1789048800.986839:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a418a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+13:2393:x1875953097771392:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048800.986874:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048800.986882:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c087775a8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29bee expref: 13 pid: 19099 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.986894:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c087775a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29bee expref: 13 pid: 19099 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.986916:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c087775a8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29bee expref: 13 pid: 19099 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.986931:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff959c3ef1e200) 00010000:00010000:2.0:1789048800.986936:0:17107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087775d2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.986945:0:17107:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087775d2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.986953:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087775d2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048800.986990:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048800.987067:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a418a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+12:2393:x1875953097771392:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 229us (2121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048800.987080:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00010000:00010000:1.0:1789048800.988724:0:19099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087775d2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048800.988739:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087775d2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048800.988780:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060e00/0x133f221c087775d9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048800.988792:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060e00/0x133f221c087775d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048800.988801:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060e00/0x133f221c087775d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048800.989312:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087775e0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048800.989323:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087775e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048800.989466:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087775e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048800.989478:0:19099:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789048800.989526:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087775d2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048800.989602:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087775d2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048800.989611:0:19099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087775d2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048800.989617:0:19099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048800.989622:0:19099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087775d2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048800.989642:0:19099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087775d2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048800.989654:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff959c3ef1e200) 00010000:00010000:1.0:1789048800.989657:0:19099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048800.989662:0:19099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087775d2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048800.989668:0:19099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c087775d2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789048800.989682:0:19099:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000069bce342 reply state 0000000014b1aab1 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060e00/0x133f221c087775d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048800.989692:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060e00/0x133f221c087775d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048800.989698:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff959c3ef1f700) 00010000:00010000:1.0:1789048800.989700:0:19099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789048800.989704:0:19099:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789048800.989741:0:19099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c087775cb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bfc expref: 15 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048800.989757:0:19099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087775e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bfc expref: 14 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048800.989765:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:1.0:1789048800.989767:0:19099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789048800.989770:0:19099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07061000, rc 0) 00000100:00100000:1.0:1789048800.989852:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a41b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+15:15594:x1875953097771264:12345-192.168.202.16@tcp:101:bash.0 Request processed in 14017us (15405us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789048800.989861:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:1.0:1789048801.007140:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048801.007251:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097771520 00000100:00100000:2.0:1789048801.007271:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097771520 00000100:00100000:2.0:1789048801.007369:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:2.0:1789048801.007381:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a41a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+15:15594:x1875953097771520:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789048801.007409:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048801.007431:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087775ee lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c03 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.007496:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087775f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.007510:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087775f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.007521:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087775f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048801.007586:0:17123:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789048801.007590:0:17123:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789048801.007609:0:17123:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087775f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.007619:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087775f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.007642:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c087775ee lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c03 expref: 17 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.007663:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087775f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c03 expref: 16 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.007686:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:2.0:1789048801.007689:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789048801.007692:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0800, rc 0) 00000100:00100000:2.0:1789048801.007754:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a41a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+16:15594:x1875953097771520:12345-192.168.202.16@tcp:101:bash.0 Request processed in 376us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048801.007761:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:3.0:1789048801.014032:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048801.015387:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097771776 00000100:00100000:2.0:1789048801.015401:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097771776 00000100:00100000:2.0:1789048801.015473:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:2.0:1789048801.015484:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+16:15594:x1875953097771776:12345-192.168.202.16@tcp:35:bash.0 00000001:00080000:2.0:1789048801.015699:0:17125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934601 00000100:00100000:2.0:1789048801.015789:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+18:15594:x1875953097771776:12345-192.168.202.16@tcp:35:bash.0 Request processed in 307us (1769us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1789048801.015794:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000020:00080000:2.0:1789048801.015807:0:17125:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789048801.210063:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048801.210241:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097772032 00000100:00100000:3.0:1789048801.210251:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097772032 00000100:00100000:3.0:1789048801.210320:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:3.0:1789048801.210330:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a41a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+18:15604:x1875953097772032:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789048801.210416:0:17124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048801.210437:0:17124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087775fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c0a expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048801.210535:0:17124:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789048801.210655:0:17124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087775fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c0a expref: 20 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048801.210669:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfcd00) 00010000:00010000:3.0:1789048801.210672:0:17124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789048801.210677:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c087775fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c0a expref: 20 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048801.210693:0:17124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3c800, rc 0) 00000100:00100000:3.0:1789048801.210771:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a41a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+19:15604:x1875953097772032:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 442us (716us total) trans 8589934603 rc 301/301 00000100:00100000:3.0:1789048801.210778:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:3.0:1789048801.213907:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048801.214397:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097772288 00000100:00100000:0.0:1789048801.214419:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097772288 00000100:00100000:0.0:1789048801.214487:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:0.0:1789048801.214497:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+19:15604:x1875953097772288:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:0.0:1789048801.214732:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+20:15604:x1875953097772288:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 235us (833us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789048801.214740:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000040:00080000:3.0:1789048801.246562:0:17157:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789048801.316718:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048801.317525:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097772544 00000100:00100000:2.0:1789048801.317537:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097772544 00000100:00100000:2.0:1789048801.317611:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:2.0:1789048801.317623:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+20:15607:x1875953097772544:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048801.317649:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048801.317668:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877760a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c11 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.317775:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08777611 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.317946:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08777611 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.317961:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08777611 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048801.317975:0:17123:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789048801.318295:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877760a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c11 expref: 23 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.318317:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08777611 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c11 expref: 22 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.318326:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:2.0:1789048801.318329:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789048801.318386:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1800, rc 0) 00000100:00100000:2.0:1789048801.318975:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+22:15607:x1875953097772544:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1352us (2265us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789048801.318985:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:3.0:1789048801.329397:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048801.329441:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097772672 00000100:00100000:2.0:1789048801.329451:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097772672 00000100:00100000:2.0:1789048801.329510:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:2.0:1789048801.329520:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+22:15607:x1875953097772672:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:2.0:1789048801.329595:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877761f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.329611:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877761f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.329634:0:17124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877761f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.329667:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877761f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.329674:0:17124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877761f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.329680:0:17124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877761f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.329685:0:17124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048801.329689:0:17124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877761f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.329695:0:17124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877761f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.329705:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:2.0:1789048801.329707:0:17124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789048801.329711:0:17124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877761f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.329716:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877761f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048801.329779:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+22:15607:x1875953097772672:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 260us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048801.329785:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:3.0:1789048801.332156:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048801.332236:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048801.332686:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097772800 00000100:00100000:2.0:1789048801.332695:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097772800 00000100:00100000:2.0:1789048801.332757:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:2.0:1789048801.332767:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+22:2394:x1875953097772800:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048801.332781:0:17109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048801.332804:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08777611 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c11 expref: 22 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.332824:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:2.0:1789048801.332829:0:17109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048801.332888:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+21:2394:x1875953097772800:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 123us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048801.332895:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:0.0:1789048801.333022:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097773056 00000100:00100000:0.0:1789048801.333027:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097773056 00000100:00100000:0.0:1789048801.333063:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:0.0:1789048801.333070:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+21:15607:x1875953097773056:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:0.0:1789048801.333286:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+22:15607:x1875953097773056:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 215us (1049us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1789048801.333292:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000040:00080000:0.0:1789048801.437965:0:17877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789048801.806961:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048801.807393:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097773312 00000100:00100000:2.0:1789048801.807415:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097773312 00000100:00100000:2.0:1789048801.807549:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:2.0:1789048801.807560:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+22:15638:x1875953097773312:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:2.0:1789048801.807587:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048801.807611:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08777626 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c18 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.807728:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877762d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.807743:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877762d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.807755:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877762d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048801.807785:0:17122:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789048801.807920:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08777626 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c18 expref: 25 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.807944:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877762d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c18 expref: 24 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048801.807953:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:2.0:1789048801.807955:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789048801.807959:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0a00, rc 0) 00000100:00100000:2.0:1789048801.808023:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+24:15638:x1875953097773312:12345-192.168.202.16@tcp:101:cat.0 Request processed in 465us (1072us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789048801.808030:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:3.0:1789048801.822051:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048801.822772:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097773440 00000100:00100000:0.0:1789048801.822784:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097773440 00000100:00100000:0.0:1789048801.822865:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:0.0:1789048801.822876:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+24:2391:x1875953097773440:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048801.822891:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048801.822918:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c0877762d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c18 expref: 24 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048801.822943:0:17108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:0.0:1789048801.822965:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048801.823027:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+23:2391:x1875953097773440:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 153us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048801.823045:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:3.0:1789048801.829114:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048801.829219:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097773696 00000100:00100000:0.0:1789048801.829228:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097773696 00000100:00100000:0.0:1789048801.829296:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1789048801.829307:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+23:15638:x1875953097773696:12345-192.168.202.16@tcp:35:cat.0 00000001:00080000:0.0:1789048801.829814:0:17125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934608 00000100:00100000:0.0:1789048801.830008:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+25:15638:x1875953097773696:12345-192.168.202.16@tcp:35:cat.0 Request processed in 701us (900us total) trans 8589934609 rc 0/0 00000100:00100000:0.0:1789048801.830018:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000020:00080000:0.0:1789048801.830022:0:17125:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789048801.886027:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048801.967547:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048801.967649:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097773952 00000100:00100000:0.0:1789048801.967659:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097773952 00000100:00100000:0.0:1789048801.967729:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:0.0:1789048801.967739:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+25:15644:x1875953097773952:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:0.0:1789048801.967762:0:19099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048801.967783:0:19099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877763b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c1f expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048801.967896:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39400/0x133f221c08777642 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048801.967911:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39400/0x133f221c08777642 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048801.967923:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39400/0x133f221c08777642 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048801.967949:0:19099:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789048801.968079:0:19099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877763b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c1f expref: 28 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048801.968099:0:19099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39400/0x133f221c08777642 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c1f expref: 27 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048801.968107:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:0.0:1789048801.968110:0:19099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048801.968113:0:19099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39400, rc 0) 00000100:00100000:0.0:1789048801.968175:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+27:15644:x1875953097773952:12345-192.168.202.16@tcp:101:dd.0 Request processed in 437us (649us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1789048801.968183:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:3.0:1789048801.972307:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048801.972385:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048801.972543:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097774208 00000100:00100000:1.0:1789048801.972552:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097774208 00000100:00100000:1.0:1789048801.972628:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:1.0:1789048801.972639:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+27:2391:x1875953097774208:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048801.972655:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048801.972678:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39400/0x133f221c08777642 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c1f expref: 27 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048801.972698:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:1.0:1789048801.972704:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048801.972760:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+26:2391:x1875953097774208:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 123us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048801.972768:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:0.0:1789048801.973711:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097774080 00000100:00100000:0.0:1789048801.973720:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097774080 00000100:00100000:0.0:1789048801.973770:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:0.0:1789048801.973779:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+26:15644:x1875953097774080:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:0.0:1789048801.973807:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048801.973826:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38c00/0x133f221c08777650 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c26 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048801.973859:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08777657 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048801.973871:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08777657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048801.973897:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08777657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048801.973999:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38c00/0x133f221c08777650 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c26 expref: 28 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048801.974015:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08777657 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c26 expref: 27 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048801.974024:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:0.0:1789048801.974027:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789048801.974030:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38400, rc 0) 00000100:00100000:0.0:1789048801.974089:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+27:15644:x1875953097774080:12345-192.168.202.16@tcp:101:dd.0 Request processed in 311us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048801.974095:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:3.0:1789048801.981276:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048801.981516:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097774464 00000100:00100000:0.0:1789048801.981536:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097774464 00000100:00100000:0.0:1789048801.981597:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:0.0:1789048801.981608:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+27:15644:x1875953097774464:12345-192.168.202.16@tcp:36:dd.0 00010000:00010000:0.0:1789048801.981662:0:19099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048801.981690:0:19099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087775f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c03 expref: 27 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048801.981711:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:0.0:1789048801.981716:0:19099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789048801.982127:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877765e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048801.982143:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877765e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048801.982153:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877765e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789048801.982203:0:19099:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934611 00000004:00010000:1.0:1789048801.982252:0:19099:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000003477e1da reply state 00000000cd48f2ff transno 8589934612 ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877765e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048801.982266:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877765e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048801.982273:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:1.0:1789048801.982276:0:19099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789048801.982279:0:19099:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789048801.982405:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+29:15644:x1875953097774464:12345-192.168.202.16@tcp:36:dd.0 Request processed in 797us (1137us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1789048801.982413:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 45 00000020:00080000:1.0:1789048801.982418:0:19099:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789048802.178676:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048802.178845:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097774720 00000100:00100000:1.0:1789048802.178856:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097774720 00000100:00100000:1.0:1789048802.178934:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:1.0:1789048802.178946:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+29:15644:x1875953097774720:12345-192.168.202.16@tcp:35:dd.0 00000100:00100000:1.0:1789048802.179689:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+30:15644:x1875953097774720:12345-192.168.202.16@tcp:35:dd.0 Request processed in 741us (1019us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1789048802.179701:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00080000:3.0:1789048802.180411:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048802.476351:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048802.479453:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097774848 00000100:00100000:0.0:1789048802.479497:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097774848 00000100:00100000:0.0:1789048802.479577:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:0.0:1789048802.479587:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+30:15658:x1875953097774848:12345-192.168.202.16@tcp:101:stat.0 00010000:00010000:0.0:1789048802.479610:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048802.479630:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38c00/0x133f221c08777665 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c2d expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.479698:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877766c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.479715:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877766c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.479729:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877766c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.479742:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08777673 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.479748:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08777673 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.479754:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08777673 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.480022:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c0877767a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.480033:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c0877767a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.480041:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c0877767a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048802.480097:0:17123:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789048802.480101:0:17123:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789048802.480143:0:17123:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c0877767a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.480156:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c0877767a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.480164:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877766c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.480170:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877766c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.480176:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877766c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.480182:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048802.480186:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877766c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.480330:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877766c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.480378:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff959c3ef1e200) 00010000:00010000:0.0:1789048802.480382:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048802.480524:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877766c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.480532:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877766c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.480557:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08777673 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.480563:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08777673 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.480568:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08777673 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.480573:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048802.480576:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08777673 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.480582:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08777673 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.480590:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff959c3ef1f700) 00010000:00010000:0.0:1789048802.480592:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048802.480595:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08777673 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.480601:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c08777673 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.480631:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38c00/0x133f221c08777665 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c2d expref: 32 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.480644:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c0877767a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c2d expref: 31 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.480662:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:0.0:1789048802.480664:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048802.480667:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39a00, rc 0) 00000100:00100000:0.0:1789048802.480758:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+31:15658:x1875953097774848:12345-192.168.202.16@tcp:101:stat.0 Request processed in 1170us (4429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048802.480767:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:2.0:1789048802.590535:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048802.590776:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097775104 00000100:00100000:3.0:1789048802.590791:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097775104 00000100:00100000:3.0:1789048802.590887:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:3.0:1789048802.590899:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+31:15664:x1875953097775104:12345-192.168.202.16@tcp:36:truncate.0 00010000:00010000:3.0:1789048802.590976:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048802.591013:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39a00/0x133f221c0877767a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c2d expref: 31 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048802.591052:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:3.0:1789048802.591060:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789048802.591315:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777681 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048802.591405:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048802.591420:0:17124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789048802.591476:0:17124:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934614 00000004:00010000:3.0:1789048802.591504:0:17124:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000030449472 reply state 00000000d2e5e852 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048802.591531:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777681 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048802.591539:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:3.0:1789048802.591561:0:17124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789048802.591565:0:17124:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789048802.592288:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+33:15664:x1875953097775104:12345-192.168.202.16@tcp:36:truncate.0 Request processed in 1387us (1775us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1789048802.592309:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 47 00000020:00080000:3.0:1789048802.592418:0:17124:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789048802.910701:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048802.927573:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048802.927866:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097775232 00000100:00100000:0.0:1789048802.927881:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097775232 00000100:00100000:0.0:1789048802.927958:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:0.0:1789048802.927970:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+33:15678:x1875953097775232:12345-192.168.202.16@tcp:101:stat.0 00010000:00010000:0.0:1789048802.928005:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048802.928033:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38c00/0x133f221c08777688 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c34 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928123:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c0877768f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928141:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c0877768f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928156:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c0877768f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928169:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777696 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928178:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777696 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928214:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777696 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928322:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877769d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928366:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877769d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928375:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877769d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048802.928428:0:17123:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1789048802.928439:0:17123:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789048802.928467:0:17123:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877769d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928482:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877769d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928492:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c0877768f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928499:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c0877768f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928507:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c0877768f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928634:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048802.928640:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c0877768f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928660:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c0877768f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928675:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff959c3ef1e200) 00010000:00010000:0.0:1789048802.928678:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048802.928684:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c0877768f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928691:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c0877768f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928705:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777696 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928711:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777696 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928716:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777696 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928721:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048802.928723:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777696 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928729:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777696 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928735:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff959c3ef1f700) 00010000:00010000:0.0:1789048802.928737:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048802.928740:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777696 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928756:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777696 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928792:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38c00/0x133f221c08777688 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c34 expref: 35 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928808:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877769d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c34 expref: 34 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048802.928815:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:0.0:1789048802.928818:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048802.928820:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38a00, rc 0) 00000100:00100000:0.0:1789048802.928908:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+34:15678:x1875953097775232:12345-192.168.202.16@tcp:101:stat.0 Request processed in 940us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048802.928916:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:1.0:1789048803.046106:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048803.046250:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097775488 00000100:00100000:2.0:1789048803.046269:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097775488 00000100:00100000:2.0:1789048803.046400:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:2.0:1789048803.046424:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a41ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+34:15688:x1875953097775488:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048803.046466:0:19099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048803.046498:0:19099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c087776a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c3b expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048803.046827:0:19099:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789048803.046970:0:19099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c087776a4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c3b expref: 36 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.047015:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfcd00) 00010000:00010000:2.0:1789048803.047018:0:19099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789048803.047026:0:19099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c087776a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c3b expref: 36 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.047049:0:19099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1000, rc 0) 00000100:00100000:2.0:1789048803.047153:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a41ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+35:15688:x1875953097775488:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 731us (1062us total) trans 8589934616 rc 301/301 00000100:00100000:2.0:1789048803.047163:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:2.0:1789048803.059956:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048803.060142:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097775744 00000100:00100000:0.0:1789048803.060156:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097775744 00000100:00100000:0.0:1789048803.060251:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:0.0:1789048803.060265:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41505c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+35:15688:x1875953097775744:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:0.0:1789048803.060751:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41505c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+36:15688:x1875953097775744:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 487us (820us total) trans 8589934617 rc 0/0 00000100:00100000:0.0:1789048803.060762:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:1.0:1789048803.192040:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048803.192207:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097776000 00000100:00100000:2.0:1789048803.192222:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097776000 00000100:00100000:2.0:1789048803.192303:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:2.0:1789048803.192315:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+36:15694:x1875953097776000:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789048803.192397:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048803.192442:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c087776b2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c42 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.192856:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087776b9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.192879:0:17122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087775e0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bfc expref: 37 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.192890:0:17122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877769d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c34 expref: 37 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.192930:0:17122:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087776b9 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.193000:0:17122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877769d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c34 expref: 37 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.193019:0:17122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877769d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c34 expref: 37 pid: 17123 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048803.193039:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e55c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17122:1875953111488640:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789048803.193200:0:17122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087775e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29bfc expref: 37 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.193211:0:17122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087775e0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29bfc expref: 37 pid: 19099 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048803.193222:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06973b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17122:1875953111488768:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789048803.193979:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2a562b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789048803.206076:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048803.206692:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097776128 00000100:00100000:3.0:1789048803.206706:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097776128 00010000:00010000:3.0:1789048803.206762:0:17109:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877769d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c34 expref: 38 pid: 17123 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048803.206814:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:3.0:1789048803.206827:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04cbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+38:2394:x1875953097776128:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048803.206848:0:17109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048803.206857:0:17109:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877769d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c34 expref: 38 pid: 17123 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.206872:0:17109:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877769d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c34 expref: 38 pid: 17123 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.206903:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:3.0:1789048803.206911:0:17109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087776b9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.206922:0:17109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087776b9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.206953:0:17109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048803.207764:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04cbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+38:2394:x1875953097776128:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 932us (1699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048803.207776:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:0.0:1789048803.214483:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048803.214557:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097776256 00000100:00100000:0.0:1789048803.214569:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097776256 00010000:00010000:0.0:1789048803.214642:0:17108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087775e0 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29bfc expref: 38 pid: 19099 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048803.214721:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:0.0:1789048803.214733:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+38:2393:x1875953097776256:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048803.214755:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048803.214764:0:17108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087775e0 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29bfc expref: 38 pid: 19099 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.214779:0:17108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087775e0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29bfc expref: 38 pid: 19099 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.214808:0:17108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:0.0:1789048803.214815:0:17108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087776b9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.214827:0:17108:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087776b9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.214836:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087776b9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.214862:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048803.214923:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+38:2393:x1875953097776256:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 192us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048803.214932:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00010000:00010000:2.0:1789048803.216945:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c0877769d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c34 expref: 37 pid: 17123 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048803.216975:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e55c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17122:1875953111488640:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789048803.217068:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087775e0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29bfc expref: 36 pid: 19099 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048803.217104:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06973b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17122:1875953111488768:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789048803.217138:0:17122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087776b9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.217149:0:17122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087776b9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.217157:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087776b9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048803.219200:0:17122:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1789048803.219509:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c087776b2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c42 expref: 37 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.219558:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087776b9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c42 expref: 36 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.219570:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:2.0:1789048803.219574:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789048803.219579:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0000, rc 0) 00000100:00100000:2.0:1789048803.219698:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+36:15694:x1875953097776000:12345-192.168.202.16@tcp:101:bash.0 Request processed in 27383us (27672us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1789048803.219710:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:0.0:1789048803.222528:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048803.222769:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097776512 00000100:00100000:2.0:1789048803.222782:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097776512 00000100:00100000:2.0:1789048803.222860:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:2.0:1789048803.222872:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+36:15694:x1875953097776512:12345-192.168.202.16@tcp:36:bash.0 00010000:00010000:2.0:1789048803.223252:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087776c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.223276:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087776c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.223291:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087776c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789048803.223386:0:19099:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000004:00010000:2.0:1789048803.223584:0:19099:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000d7370f73 reply state 000000006f1c1b77 transno 8589934620 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087776c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.223600:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087776c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.223608:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:2.0:1789048803.223611:0:19099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789048803.223618:0:19099:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789048803.223747:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+39:15694:x1875953097776512:12345-192.168.202.16@tcp:36:bash.0 Request processed in 875us (1234us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789048803.223756:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 51 00000020:00080000:2.0:1789048803.223763:0:19099:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789048803.227760:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048803.228099:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097776640 00000100:00100000:0.0:1789048803.228115:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097776640 00000100:00100000:0.0:1789048803.228200:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:0.0:1789048803.228233:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+39:15694:x1875953097776640:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048803.228270:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048803.228301:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38c00/0x133f221c087776ce lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c49 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.228443:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38c00/0x133f221c087776ce lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c49 expref: 40 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.228476:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38c00/0x133f221c087776ce lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c49 expref: 40 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.228500:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:0.0:1789048803.228503:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789048803.228508:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38c00, rc 0) 00000100:00100000:0.0:1789048803.228597:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+40:15694:x1875953097776640:12345-192.168.202.16@tcp:101:bash.0 Request processed in 368us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048803.228605:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:1.0:1789048803.238602:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048803.238789:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097776768 00000100:00100000:2.0:1789048803.238803:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097776768 00000100:00100000:2.0:1789048803.238886:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:2.0:1789048803.238898:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+40:15694:x1875953097776768:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789048803.238929:0:19099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048803.238959:0:19099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c087776d5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c50 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.239144:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776dc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.239165:0:19099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087776b9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c42 expref: 41 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.239175:0:19099:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776dc lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.239233:0:19099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087776b9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c42 expref: 41 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.239250:0:19099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087776b9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c42 expref: 41 pid: 17122 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048803.239269:0:19099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06973b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19099:1875953111488896:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789048803.239436:0:19099:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2a5620c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048803.244974:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048803.245168:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097776896 00000100:00100000:0.0:1789048803.245197:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097776896 00010000:00010000:0.0:1789048803.245256:0:17108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087776b9 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c42 expref: 42 pid: 17122 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048803.245438:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:0.0:1789048803.245463:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+42:2393:x1875953097776896:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048803.245489:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048803.245498:0:17108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087776b9 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c42 expref: 42 pid: 17122 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.245539:0:17108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087776b9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c42 expref: 42 pid: 17122 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.245570:0:17108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:0.0:1789048803.245577:0:17108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776dc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.245589:0:17108:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.245597:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776dc lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.245637:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048803.245714:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+42:2393:x1875953097776896:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 266us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048803.245723:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00010000:00010000:2.0:1789048803.245884:0:19099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c087776b9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c42 expref: 41 pid: 17122 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048803.245912:0:19099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06973b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19099:1875953111488896:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789048803.245945:0:19099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.245956:0:19099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.245975:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048803.246052:0:19099:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789048803.246057:0:19099:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789048803.246084:0:19099:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.246124:0:19099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c087776d5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c50 expref: 41 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.246143:0:19099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c50 expref: 40 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.246151:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:2.0:1789048803.246154:0:19099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789048803.246157:0:19099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0800, rc 0) 00000100:00100000:2.0:1789048803.248562:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+40:15694:x1875953097776768:12345-192.168.202.16@tcp:101:bash.0 Request processed in 9646us (9959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048803.248579:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:3.0:1789048803.256525:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048803.256838:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097777152 00000100:00100000:2.0:1789048803.256853:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097777152 00000100:00100000:2.0:1789048803.256938:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:2.0:1789048803.256951:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+40:15694:x1875953097777152:12345-192.168.202.16@tcp:103:bash.0 00010000:00010000:2.0:1789048803.256972:0:17109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789048803.257008:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38c00/0x133f221c087776ce lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c49 expref: 40 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.257064:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776dc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c50 expref: 39 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.257079:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:2.0:1789048803.257085:0:17109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048803.257166:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+38:15694:x1875953097777152:12345-192.168.202.16@tcp:103:bash.0 Request processed in 217us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048803.257175:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:2.0:1789048803.269857:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048803.274753:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097777280 00000100:00100000:0.0:1789048803.274774:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097777280 00000100:00100000:2.0:1789048803.278916:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:2.0:1789048803.278936:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+38:15694:x1875953097777280:12345-192.168.202.16@tcp:58:bash.0 00010000:00010000:2.0:1789048803.279097:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776e3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.279124:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776e3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.279142:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776e3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789048803.284867:0:17123:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789048803.285743:0:17123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789048803.285966:0:17123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789048803.287464:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+38:15694:x1875953097777280:12345-192.168.202.16@tcp:58:bash.0 Request processed in 8520us (17611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048803.287480:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:3.0:1789048803.295576:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048803.295635:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097777408 00000100:00100000:3.0:1789048803.295648:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097777408 00000100:00100000:3.0:1789048803.295834:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:3.0:1789048803.295847:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+38:15694:x1875953097777408:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1789048803.295880:0:17124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048803.295912:0:17124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c600/0x133f221c087776ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c57 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.295995:0:17124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776e3 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.296009:0:17124:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c600/0x133f221c087776ea lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c57 expref: 39 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789048803.297583:0:17157:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789048803.297593:0:17157:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789048803.297673:0:17157:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789048803.297685:0:17157:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789048803.297857:0:17157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08a05880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17157:1875953111489024:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789048803.297995:0:17157:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c426c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789048803.299201:0:17124:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776e3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.299239:0:17124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c600/0x133f221c087776ea lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c57 expref: 40 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.299283:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:3.0:1789048803.299286:0:17124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789048803.299292:0:17124:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c600/0x133f221c087776ea lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c57 expref: 40 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.301212:0:17124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3c600, rc 0) 00000100:00100000:3.0:1789048803.301914:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+40:15694:x1875953097777408:12345-192.168.202.16@tcp:101:bash.0 Request processed in 6059us (6346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048803.301930:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:0.0:1789048803.310217:0:17157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08a05880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17157:1875953111489024:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789048803.311766:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048803.312077:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097777536 00000100:00100000:3.0:1789048803.312091:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097777536 00000100:00100000:3.0:1789048803.312174:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:3.0:1789048803.312198:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a41b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+39:15695:x1875953097777536:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789048803.312250:0:17122:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789048803.312448:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a41b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+39:15695:x1875953097777536:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 263us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048803.312764:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:1.0:1789048803.313025:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789048803.313048:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111489152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789048803.313122:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048803.313427:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111489152 00000100:00100000:2.0:1789048803.313453:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111489152 00000100:00100000:2.0:1789048803.313521:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789048803.313532:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a419f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111489152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789048803.313569:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789048803.313622:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a419f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111489152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048803.313629:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1789048803.314599:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789048803.315214:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111489152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048803.334937:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048803.343942:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097777664 00000100:00100000:1.0:1789048803.343990:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097777664 00000100:00100000:1.0:1789048803.344204:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:1.0:1789048803.344231:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+39:15695:x1875953097777664:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789048803.344419:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c087776f1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.344451:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c087776f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.344470:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c087776f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.344755:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087776f8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.344779:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087776f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.344793:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087776f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.344828:0:19099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060a00/0x133f221c087776ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.344839:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060a00/0x133f221c087776ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.344846:0:19099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060a00/0x133f221c087776ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048803.344914:0:19099:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789048803.344936:0:19099:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789048803.344957:0:19099:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060a00/0x133f221c087776ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.344969:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c087776f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.344976:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c087776f1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.344983:0:19099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c087776f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.344990:0:19099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07060400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048803.344995:0:19099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c087776f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.345003:0:19099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c087776f1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.345017:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff959c3ef1e700) 00010000:00010000:1.0:1789048803.345020:0:19099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048803.345025:0:19099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c087776f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.345032:0:19099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c087776f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.345049:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087776f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.345056:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087776f8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.345072:0:19099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087776f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.345078:0:19099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07061000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048803.345081:0:19099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087776f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.345088:0:19099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087776f8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.345097:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff959c3ef1f400) 00010000:00010000:1.0:1789048803.345100:0:19099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048803.345103:0:19099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087776f8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.345109:0:19099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087776f8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.345124:0:19099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060a00/0x133f221c087776ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.345131:0:19099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060a00/0x133f221c087776ff lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.345137:0:19099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060a00/0x133f221c087776ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.345143:0:19099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07060a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048803.345145:0:19099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060a00/0x133f221c087776ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.345160:0:19099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060a00/0x133f221c087776ff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.345168:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:1.0:1789048803.345170:0:19099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048803.345174:0:19099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060a00/0x133f221c087776ff lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.349507:0:19099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060a00/0x133f221c087776ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048803.349637:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+39:15695:x1875953097777664:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 Request processed in 5416us (14711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048803.349648:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:2.0:1789048803.356054:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048803.357009:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097777920 00000100:00100000:0.0:1789048803.357043:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097777920 00000100:00100000:0.0:1789048803.357127:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:0.0:1789048803.357138:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+39:15695:x1875953097777920:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789048803.357161:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048803.357579:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777706 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c5e expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.357708:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c0877770d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.357726:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c0877770d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.357740:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c0877770d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048803.357752:0:17123:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789048803.357832:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c0877770d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.357841:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c0877770d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.357848:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c0877770d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.357854:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048803.357859:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c0877770d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.357866:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c0877770d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.363717:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:0.0:1789048803.363721:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789048803.363729:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c0877770d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.363738:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38800/0x133f221c0877770d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.363817:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777706 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c5e expref: 41 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.363829:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff959c3ef1e700) 00010000:00010000:0.0:1789048803.363831:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789048803.363835:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777706 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c5e expref: 41 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.363846:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39c00, rc 0) 00000100:00100000:0.0:1789048803.363931:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+40:15695:x1875953097777920:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 6793us (7894us total) trans 8589934621 rc 301/301 00000100:00100000:0.0:1789048803.363940:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:2.0:1789048803.374564:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048803.374884:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097778048 00000100:00100000:3.0:1789048803.374895:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097778048 00000100:00100000:3.0:1789048803.374954:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:3.0:1789048803.374964:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+40:15695:x1875953097778048:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789048803.374999:0:17124:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789048803.375166:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+40:15695:x1875953097778048:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 202us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048803.375208:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:3.0:1789048803.387838:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048803.388067:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097778304 00000100:00100000:2.0:1789048803.388086:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097778304 00000100:00100000:2.0:1789048803.388235:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:2.0:1789048803.388247:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+40:15695:x1875953097778304:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789048803.388269:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048803.388302:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877771b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c65 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789048803.388741:0:17122:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:2.0:1789048803.388747:0:17122:0:(osp_object.c:1650:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1789048803.388768:0:17122:0:(osp_object.c:1667:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1789048803.388914:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777722 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.388931:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777722 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.388943:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777722 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.389020:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877771b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c65 expref: 43 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.389041:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777722 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c65 expref: 42 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.389050:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff959c05322a00) 00010000:00010000:2.0:1789048803.389053:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789048803.389057:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0a00, rc 0) 00000100:00100000:2.0:1789048803.389123:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+42:15695:x1875953097778304:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 878us (1302us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789048803.389131:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:1.0:1789048803.390222:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048803.390274:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048803.390324:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048803.390381:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097778432 00000100:00100000:3.0:1789048803.390393:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097778432 00000100:00100000:3.0:1789048803.390454:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 170 00000100:00100000:3.0:1789048803.390466:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+13:2394:x1875953097778432:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048803.390558:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+13:2394:x1875953097778432:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 94us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048803.390565:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 170 00000100:00100000:3.0:1789048803.390739:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097778688 00000100:00100000:3.0:1789048803.390744:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097778688 00000100:00100000:3.0:1789048803.390789:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:3.0:1789048803.390797:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2394:x1875953097778688:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048803.390831:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2394:x1875953097778688:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 35us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048803.390837:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00080000:3.0:1789048803.390856:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789048803.398200:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097778944 00000100:00100000:0.0:1789048803.398215:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097778944 00000100:00100000:0.0:1789048803.398307:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:0.0:1789048803.398319:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a41bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+12:2394:x1875953097778944:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048803.398424:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a41bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+12:2394:x1875953097778944:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 107us (8099us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048803.398432:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:0.0:1789048803.398510:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048803.398615:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048803.398629:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048803.398650:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048803.398662:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048803.398685:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048803.398702:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097779200 00000100:00100000:0.0:1789048803.398706:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097779200 00000100:00100000:0.0:1789048803.398734:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097778816 00000100:00100000:0.0:1789048803.398737:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097778816 00000100:00100000:0.0:1789048803.398751:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097779328 00000100:00100000:0.0:1789048803.398754:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097779328 00000100:00100000:0.0:1789048803.398768:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:0.0:1789048803.398774:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2394:x1875953097779200:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048803.398808:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2394:x1875953097779200:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 34us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048803.398814:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:0.0:1789048803.398825:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:0.0:1789048803.398831:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2394:x1875953097778816:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048803.398855:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2394:x1875953097778816:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 25us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048803.398860:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:0.0:1789048803.398894:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:0.0:1789048803.398901:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2394:x1875953097779328:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048803.398924:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2394:x1875953097779328:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 24us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048803.398941:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:0.0:1789048803.399043:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097778560 00000100:00100000:0.0:1789048803.399047:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097778560 00000100:00100000:0.0:1789048803.399065:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097779072 00000100:00100000:0.0:1789048803.399068:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097779072 00000100:00100000:0.0:1789048803.399079:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097779584 00000100:00100000:0.0:1789048803.399081:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097779584 00000100:00100000:0.0:1789048803.399095:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:0.0:1789048803.399101:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2394:x1875953097778560:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048803.399148:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2394:x1875953097778560:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 46us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048803.399154:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:0.0:1789048803.399199:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:0.0:1789048803.399206:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2394:x1875953097779072:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048803.399237:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2394:x1875953097779072:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 32us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048803.399243:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:0.0:1789048803.399272:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:0.0:1789048803.399279:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+42:15695:x1875953097779584:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789048803.399321:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048803.399373:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0a00/0x133f221c08777722 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c65 expref: 42 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.399396:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff959c05322a00) 00010000:00010000:0.0:1789048803.399406:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789048803.399437:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38c00/0x133f221c08777730 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.399451:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38c00/0x133f221c08777730 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.399461:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38c00/0x133f221c08777730 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.399508:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08777737 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7f1765d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.399517:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08777737 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7f1765d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.399525:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08777737 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7f1765d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.399570:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38c00/0x133f221c08777730 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.399579:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38c00/0x133f221c08777730 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.399586:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38c00/0x133f221c08777730 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.399592:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048803.399597:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38c00/0x133f221c08777730 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.399604:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38c00/0x133f221c08777730 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.399625:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff959c3ef1e200) 00010000:00010000:0.0:1789048803.399628:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048803.399632:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38c00/0x133f221c08777730 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.399638:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38c00/0x133f221c08777730 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.399648:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08777737 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7f1765d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.399654:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08777737 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7f1765d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.399660:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08777737 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7f1765d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.399664:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048803.399668:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08777737 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7f1765d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.399673:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08777737 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7f1765d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.399679:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x7f1765d5 (ffff959c3ef1e100) 00010000:00010000:0.0:1789048803.399681:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048803.399684:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08777737 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7f1765d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.399689:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38a00/0x133f221c08777737 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7f1765d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048803.399751:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+41:15695:x1875953097779584:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 472us (1064us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789048803.399758:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00080000:1.0:1789048803.399967:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789048803.399979:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789048803.399983:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789048803.399986:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789048803.403735:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048803.403832:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097779712 00000100:00100000:2.0:1789048803.403843:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097779712 00000100:00100000:3.0:1789048803.407619:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:3.0:1789048803.407639:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+41:15695:x1875953097779712:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789048803.407662:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048803.407689:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c0877773e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c6c expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.407726:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d200/0x133f221c08777745 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.407760:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d200/0x133f221c08777745 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.407773:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d200/0x133f221c08777745 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.408115:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c0877773e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c6c expref: 43 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.408137:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d200/0x133f221c08777745 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c6c expref: 42 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.408146:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff959b06bfcc00) 00010000:00010000:3.0:1789048803.408149:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789048803.408152:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3d200, rc 0) 00000100:00100000:3.0:1789048803.408538:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+42:15695:x1875953097779712:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 903us (4809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048803.408547:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:0.0:1789048803.414153:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048803.419780:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097779968 00000100:00100000:2.0:1789048803.419797:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097779968 00000100:00100000:3.0:1789048803.419963:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:3.0:1789048803.419974:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+42:15695:x1875953097779968:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789048803.420061:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877774c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.420078:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877774c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.420090:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877774c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789048803.420327:0:17122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1789048803.420373:0:17122:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 558174038633ns, next at 559174035036ns, rc = 0 00000004:00010000:3.0:1789048803.420431:0:17122:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000007fee62dc reply state 0000000076eb29ad transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877774c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.420444:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877774c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.420452:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff959b06bfcc00) 00010000:00010000:3.0:1789048803.420455:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789048803.420459:0:17122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789048803.420568:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+44:15695:x1875953097779968:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 594us (6424us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1789048803.420575:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:0.0:1789048803.424265:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048803.424447:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097780096 00000100:00100000:1.0:1789048803.424466:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097780096 00000100:00100000:1.0:1789048803.424811:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:1.0:1789048803.424827:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+44:15695:x1875953097780096:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789048803.424865:0:19099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048803.424896:0:19099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c08777753 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c73 expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.425759:0:19099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c08777753 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c73 expref: 45 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.425777:0:19099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c08777753 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c73 expref: 45 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.425799:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff959b06bfcc00) 00010000:00010000:1.0:1789048803.425802:0:19099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789048803.425808:0:19099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07060400, rc 0) 00000100:00100000:1.0:1789048803.425969:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+45:15695:x1875953097780096:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 1076us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048803.425979:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:1.0:1789048803.431999:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048803.432162:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097780224 00000100:00100000:0.0:1789048803.432175:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097780224 00000100:00100000:0.0:1789048803.432262:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:0.0:1789048803.432274:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2394:x1875953097780224:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789048803.432825:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:2394:x1875953097780224:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 551us (838us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789048803.432835:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:0.0:1789048803.442493:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048803.446849:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097780480 00000100:00100000:2.0:1789048803.446865:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097780480 00000100:00100000:0.0:1789048803.447470:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:0.0:1789048803.447482:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+45:15695:x1875953097780480:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789048803.449634:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+46:15695:x1875953097780480:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 2143us (7149us total) trans 8589934624 rc 0/0 00000100:00100000:0.0:1789048803.449649:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:1.0:1789048803.457077:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048803.457195:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097780736 00000100:00100000:3.0:1789048803.457209:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097780736 00000100:00100000:3.0:1789048803.457299:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:3.0:1789048803.457311:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+46:15695:x1875953097780736:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789048803.457573:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+46:15695:x1875953097780736:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 263us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048803.457595:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:1.0:1789048803.481315:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048803.486499:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097780864 00000100:00100000:3.0:1789048803.487218:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097780864 00000100:00100000:3.0:1789048803.488065:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:3.0:1789048803.488083:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+46:15695:x1875953097780864:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789048803.488114:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048803.488165:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c0877775a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c7a expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.488455:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08777761 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.488473:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08777761 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.488490:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08777761 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048803.488732:0:17123:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789048803.488759:0:17123:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08777761 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.488793:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c0877775a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c7a expref: 48 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.488816:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08777761 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c7a expref: 47 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.488825:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff959b06bfcc00) 00010000:00010000:3.0:1789048803.488828:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789048803.488831:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3d600, rc 0) 00000100:00100000:3.0:1789048803.488922:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+47:15695:x1875953097780864:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 846us (7634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048803.488931:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:0.0:1789048803.498059:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048803.498241:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097780992 00000100:00100000:1.0:1789048803.498254:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097780992 00000100:00100000:1.0:1789048803.498359:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:1.0:1789048803.498373:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:2392:x1875953097780992:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789048803.498398:0:18631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048803.498427:0:18631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000124ac425/0x133f221c08777768 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c81 expref: -99 pid: 18631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789048803.498460:0:18631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fa6891cea280, blocks: 0x0 00010000:00010000:1.0:1789048803.498486:0:18631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=558s v=(0 0) 00010000:00010000:1.0:1789048803.498520:0:18631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048803.498532:0:18631:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000124ac425/0x133f221c08777768 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c81 expref: 7 pid: 18631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.498559:0:18631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000124ac425/0x133f221c08777768 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c81 expref: 7 pid: 18631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.498586:0:18631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07060a00, rc 0) 00000100:00100000:1.0:1789048803.498669:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+7:2392:x1875953097780992:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 298us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048803.498677:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:0.0:1789048803.501505:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048803.501817:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097781248 00000100:00100000:3.0:1789048803.501831:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097781248 00000100:00100000:3.0:1789048803.501918:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:3.0:1789048803.501931:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+47:15695:x1875953097781248:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789048803.502088:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+47:15695:x1875953097781248:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 160us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048803.502096:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:3.0:1789048803.507818:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048803.507936:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097781376 00000100:00100000:1.0:1789048803.507949:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097781376 00000100:00100000:1.0:1789048803.508028:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:1.0:1789048803.508041:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+47:15695:x1875953097781376:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789048803.522904:0:17102:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934624 is committed 00000004:00080000:2.0:1789048803.522929:0:17102:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789048803.523014:0:17102:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:3.0:1789048803.523172:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c0877752a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.523172:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877757e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523199:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c0877752a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.523199:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877757e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523208:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c0877752a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523214:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07061c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048803.523219:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c0877752a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.523220:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877757e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.523226:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048803.523228:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877757e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523237:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c0877752a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.523237:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877757e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523257:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff959c3ef1fb00) 00010000:00010000:0.0:1789048803.523257:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff959c3ef1e200) 00010000:00010000:3.0:1789048803.523260:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048803.523260:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789048803.523267:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c0877752a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.523267:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877757e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523275:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c0877752a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.523275:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c0877757e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523306:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777531 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523313:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777531 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523319:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777531 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523325:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048803.523328:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777531 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523390:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777531 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523400:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff959c3ef1e200) 00010000:00010000:3.0:1789048803.523403:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048803.523406:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777531 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523412:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777531 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523425:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060e00/0x133f221c087775d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523431:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060e00/0x133f221c087775d9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523437:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060e00/0x133f221c087775d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523449:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07060e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048803.523452:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060e00/0x133f221c087775d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523459:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060e00/0x133f221c087775d9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523468:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff959c3ef1f700) 00010000:00010000:3.0:1789048803.523470:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048803.523473:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060e00/0x133f221c087775d9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523479:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060e00/0x133f221c087775d9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523495:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877765e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523501:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877765e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523507:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877765e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523525:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07061200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048803.523528:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877765e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523534:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877765e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523553:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:3.0:1789048803.523556:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048803.523559:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877765e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523566:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c0877765e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523588:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777681 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523596:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777681 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523602:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777681 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523608:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048803.523611:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777681 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523617:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777681 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523625:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:3.0:1789048803.523627:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048803.523630:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777681 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523636:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777681 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523657:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087776c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523664:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087776c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523669:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087776c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523674:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048803.523677:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087776c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523683:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087776c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523691:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:3.0:1789048803.523694:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048803.523696:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087776c7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523703:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c087776c7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523715:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877774c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523721:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877774c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523727:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877774c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523739:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3de00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048803.523742:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877774c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523749:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877774c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523757:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff959b06bfcc00) 00010000:00010000:3.0:1789048803.523759:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789048803.523762:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877774c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.523769:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3de00/0x133f221c0877774c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048803.524290:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789048803.524526:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+14:15695:x1875953097781376:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 Request processed in 16468us (16929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048803.524540:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:1.0:1789048803.527062:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048803.527175:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097781504 00000100:00100000:2.0:1789048803.527199:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097781504 00000100:00100000:2.0:1789048803.527275:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:2.0:1789048803.527288:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+7:2394:x1875953097781504:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789048803.527450:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+7:2394:x1875953097781504:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 Request processed in 164us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048803.527480:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:1.0:1789048803.529834:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048803.529927:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097781760 00000100:00100000:3.0:1789048803.529940:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097781760 00000100:00100000:3.0:1789048803.530048:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:3.0:1789048803.530061:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+14:15695:x1875953097781760:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789048803.530132:0:17122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048803.530169:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d600/0x133f221c08777761 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c7a expref: 14 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.530206:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff959b06bfcc00) 00010000:00010000:3.0:1789048803.530213:0:17122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789048803.530261:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c0877776f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.530278:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c0877776f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.530309:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c0877776f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789048803.530508:0:17122:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000009d1e65ae reply state 000000007a923b66 transno 8589934625 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c0877776f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.530535:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c0877776f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.530542:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff959b06bfcc00) 00010000:00010000:3.0:1789048803.530545:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789048803.530548:0:17122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789048803.530691:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+15:15695:x1875953097781760:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 632us (869us total) trans 8589934625 rc 0/0 00000100:00100000:3.0:1789048803.530699:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:0.0:1789048803.530798:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111489280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789048803.530858:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048803.530912:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111489280 00000100:00100000:0.0:1789048803.530917:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111489280 00000100:00100000:0.0:1789048803.530976:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789048803.530983:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111489280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789048803.531096:0:18631:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789048803.531100:0:18631:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1789048803.531103:0:18631:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789048803.531105:0:18631:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789048804026000000 -> 1789048804026000000 00002000:00010000:0.0:1789048803.531119:0:18631:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789048803.531162:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3620:x1875953111489280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (303us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789048803.531169:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1789048803.531205:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789048803.531430:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff959b08887b80/2, rc 0, transno 8589934596 00000100:00100000:2.0:1789048803.531439:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111489280:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789048803.533777:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048803.533886:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097781888 00000100:00100000:2.0:1789048803.533899:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097781888 00000100:00100000:2.0:1789048803.533997:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:2.0:1789048803.534008:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+7:15695:x1875953097781888:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789048803.534032:0:18632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048803.534127:0:18632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e248be4/0x133f221c08777776 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c88 expref: -99 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.534168:0:18632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000124ac425/0x133f221c08777768 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c81 expref: 8 pid: 18631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.534189:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048803.534195:0:18632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048803.534202:0:18632:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e248be4/0x133f221c08777776 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c88 expref: 8 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.534320:0:18632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000124ac425/0x133f221c08777768 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c81 expref: 8 pid: 18631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.534359:0:18632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000124ac425/0x133f221c08777768 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c81 expref: 8 pid: 18631 timeout: 658 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048803.534400:0:18632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18632:1875953111489408:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789048803.534562:0:18632:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2a5626c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048803.538065:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048803.538559:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097782016 00000100:00100000:1.0:1789048803.538572:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097782016 00010000:00010000:1.0:1789048803.538757:0:17108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000124ac425/0x133f221c08777768 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c81 expref: 9 pid: 18631 timeout: 658 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048803.538809:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:1.0:1789048803.538836:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+9:2394:x1875953097782016:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048803.538856:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048803.538883:0:17108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000124ac425/0x133f221c08777768 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c81 expref: 9 pid: 18631 timeout: 658 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.538900:0:17108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000124ac425/0x133f221c08777768 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c81 expref: 9 pid: 18631 timeout: 658 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.538931:0:17108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048803.538936:0:17108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048803.538944:0:17108:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e248be4/0x133f221c08777776 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c88 expref: 9 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.538956:0:17108:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e248be4/0x133f221c08777776 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c88 expref: 9 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.539003:0:17108:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009e248be4/0x133f221c08777776 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c88 expref: 9 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048803.539021:0:17108:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08885f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17108:1875953111489536:192.168.202.16@tcp:105: 00000100:00100000:1.0:1789048803.539147:0:17108:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c37fc0840 going to sleep for 11 seconds 00000100:00100000:2.0:1789048803.541951:0:17108:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08885f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17108:1875953111489536:192.168.202.16@tcp:105: 00010000:00010000:2.0:1789048803.541986:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048803.542060:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+9:2394:x1875953097782016:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3224us (4011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048803.542074:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00010000:00010000:0.0:1789048803.543944:0:18632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000124ac425/0x133f221c08777768 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c81 expref: 8 pid: 18631 timeout: 658 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048803.543974:0:18632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18632:1875953111489408:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048803.544013:0:18632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e248be4/0x133f221c08777776 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c88 expref: 7 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.544033:0:18632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1000, rc 0) 00000100:00100000:0.0:1789048803.544140:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+7:15695:x1875953097781888:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 10133us (10375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048803.544150:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:3.0:1789048803.547523:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048803.547642:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097782144 00000100:00100000:0.0:1789048803.547655:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097782144 00000100:00100000:0.0:1789048803.547739:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:0.0:1789048803.547751:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+7:2391:x1875953097782144:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789048803.547956:0:18631:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789048803.547961:0:18631:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789048803835000000 00002000:00010000:0.0:1789048803.547963:0:18631:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789048801575257089 00002000:00010000:0.0:1789048803.547966:0:18631:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789048804026000000 -> 1789048803835000000 00002000:00010000:0.0:1789048803.547969:0:18631:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789048803.548057:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+8:2391:x1875953097782144:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 308us (550us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789048803.548066:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:2.0:1789048803.551494:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048803.551692:0:18630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097782272 00000100:00100000:3.0:1789048803.551705:0:18630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097782272 00000100:00100000:3.0:1789048803.551779:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:3.0:1789048803.551793:0:18630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+8:2392:x1875953097782272:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789048803.551852:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ec101c8f/0x133f221c0877777d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.551879:0:18630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e248be4/0x133f221c08777776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c88 expref: 8 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.551888:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048803.551911:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789048803.551917:0:18630:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec101c8f/0x133f221c0877777d lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.551966:0:18630:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e248be4/0x133f221c08777776 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c88 expref: 8 pid: 18632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.551982:0:18630:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e248be4/0x133f221c08777776 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c88 expref: 8 pid: 18632 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048803.552000:0:18630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c323e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18630:1875953111489664:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048803.552121:0:18630:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c414b0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789048803.555868:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048803.555976:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097782400 00000100:00100000:0.0:1789048803.555987:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097782400 00010000:00010000:0.0:1789048803.556038:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e248be4/0x133f221c08777776 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c88 expref: 9 pid: 18632 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048803.556091:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:0.0:1789048803.556102:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08884a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+9:2393:x1875953097782400:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048803.556122:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048803.556149:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e248be4/0x133f221c08777776 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c88 expref: 9 pid: 18632 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.556165:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e248be4/0x133f221c08777776 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c88 expref: 9 pid: 18632 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.556207:0:17107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789048803.556212:0:17107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789048803.556219:0:17107:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec101c8f/0x133f221c0877777d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.556239:0:17107:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec101c8f/0x133f221c0877777d lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.556268:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048803.556388:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08884a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+9:2393:x1875953097782400:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 287us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048803.556397:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00010000:00010000:3.0:1789048803.556991:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e248be4/0x133f221c08777776 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c88 expref: 8 pid: 18632 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048803.557012:0:18630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c323e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18630:1875953111489664:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048803.557038:0:18630:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ec101c8f/0x133f221c0877777d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.557049:0:18630:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ec101c8f/0x133f221c0877777d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.557057:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec101c8f/0x133f221c0877777d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.557084:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ec101c8f/0x133f221c0877777d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.557103:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec101c8f/0x133f221c0877777d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.557112:0:18630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec101c8f/0x133f221c0877777d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.557120:0:18630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048803.557125:0:18630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec101c8f/0x133f221c0877777d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.557135:0:18630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec101c8f/0x133f221c0877777d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.557152:0:18630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec101c8f/0x133f221c0877777d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.557159:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec101c8f/0x133f221c0877777d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048803.557278:0:18630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+7:2392:x1875953097782272:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 Request processed in 5488us (5798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048803.557288:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:1.0:1789048803.560475:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048803.560671:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097782656 00000100:00100000:3.0:1789048803.560686:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097782656 00000100:00100000:3.0:1789048803.560763:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:3.0:1789048803.560796:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+15:15695:x1875953097782656:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789048803.560918:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777784 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.560940:0:17123:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08777657 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c26 expref: 15 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.560952:0:17123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777784 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.561000:0:17123:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08777657 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c26 expref: 15 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.561016:0:17123:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08777657 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c26 expref: 15 pid: 17123 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048803.561033:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c323e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17123:1875953111489792:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048803.561393:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c414b0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789048803.567965:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048803.568562:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097782784 00000100:00100000:2.0:1789048803.568575:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097782784 00010000:00010000:2.0:1789048803.568641:0:17108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08777657 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c26 expref: 16 pid: 17123 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048803.568692:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:2.0:1789048803.568703:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08886d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+16:2393:x1875953097782784:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048803.568721:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048803.568729:0:17108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08777657 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c26 expref: 16 pid: 17123 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.568745:0:17108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08777657 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c26 expref: 16 pid: 17123 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.568774:0:17108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:2.0:1789048803.568810:0:17108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c600/0x133f221c087776ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c57 expref: 16 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.568823:0:17108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777784 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.568831:0:17108:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777784 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.568841:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777784 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.568867:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048803.568938:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08886d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+16:2393:x1875953097782784:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 236us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048803.568947:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00010000:00010000:3.0:1789048803.570501:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08777657 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c26 expref: 15 pid: 17123 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048803.570537:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c323e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17123:1875953111489792:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048803.570566:0:17123:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777784 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.570804:0:17123:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777784 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.570812:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777784 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.571100:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c0877778b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.571119:0:17123:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c08777753 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c73 expref: 15 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.571129:0:17123:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c0877778b lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.571190:0:17123:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c08777753 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c73 expref: 15 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048803.571218:0:17123:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c08777753 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c73 expref: 15 pid: 19099 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048803.571800:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fb33b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17123:1875953111489920:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789048803.571921:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2a562b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789048803.574974:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048803.575136:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fb33b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17123:1875953111489920:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789048803.575171:0:17123:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c0877778b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048803.576169:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097782912 00000100:00100000:0.0:1789048803.576193:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097782912 00010000:00010000:0.0:1789048803.576318:0:17109:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c08777753 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c73 expref: 16 pid: 19099 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048803.576498:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:0.0:1789048803.576521:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04cbb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+16:2394:x1875953097782912:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048803.576541:0:17109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048803.576550:0:17109:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c08777753 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c73 expref: 16 pid: 19099 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.576566:0:17109:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c08777753 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c73 expref: 16 pid: 19099 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.576717:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c08777753 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29c73 expref: 16 pid: 19099 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.576738:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff959b06bfcc00) 00010000:00010000:0.0:1789048803.576744:0:17109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c0877778b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.576754:0:17109:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c0877778b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.576764:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c0877778b lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.576823:0:17109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048803.576907:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04cbb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+15:2394:x1875953097782912:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 398us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048803.576915:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00010000:00010000:1.0:1789048803.578090:0:17123:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c0877778b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.578121:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c0877778b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789048803.578296:0:17123:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000001:00080000:1.0:1789048803.578492:0:17123:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000001:00080000:1.0:1789048803.578546:0:17123:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934628 00000100:00100000:1.0:1789048803.578947:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08885c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17123:1875953111490048:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789048803.579158:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048803.579221:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c07a21000 going to sleep for 11 seconds 00000100:00100000:3.0:1789048803.579488:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111490048 00000100:00100000:3.0:1789048803.579500:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111490048 00000100:00100000:3.0:1789048803.579603:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789048803.579614:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17123:x1875953111490048:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789048803.579732:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17123:x1875953111490048:12345-0@lo:1000:mdt00_001.0 Request processed in 120us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048803.579741:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789048803.580062:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08885c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17123:1875953111490048:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789048803.580699:0:17123:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000100:00100000:1.0:1789048803.580788:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08885c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17123:1875953111490176:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789048803.580844:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048803.580885:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c37fc0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789048803.581056:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111490176 00000100:00100000:2.0:1789048803.581065:0:18100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111490176 00000100:00100000:2.0:1789048803.581116:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789048803.581126:0:18100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17123:x1875953111490176:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789048803.581460:0:18100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17123:x1875953111490176:12345-0@lo:1000:mdt00_001.0 Request processed in 334us (615us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1789048803.581469:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789048803.581807:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08885c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17123:1875953111490176:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789048803.581861:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c0877778b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.581873:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c0877778b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.581881:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c0877778b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.581888:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048803.581893:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c0877778b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.581928:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c0877778b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.581949:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff959b06bfcc00) 00010000:00010000:1.0:1789048803.581953:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789048803.581959:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c0877778b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.581966:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0000/0x133f221c0877778b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.582008:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776e3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.582014:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776e3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.582020:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776e3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.582026:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048803.582029:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776e3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.582046:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776e3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.582056:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:1.0:1789048803.582058:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789048803.582065:0:17123:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c600/0x133f221c087776ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c57 expref: 18 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.582090:0:17123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c600/0x133f221c087776ea lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c57 expref: 18 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.582101:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c600/0x133f221c087776ea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c57 expref: 18 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.582167:0:17123:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c600/0x133f221c087776ea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c57 expref: 18 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048803.582195:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08884a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17123:1875953111490304:192.168.202.16@tcp:105: 00000100:00100000:1.0:1789048803.582570:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c37fc0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789048803.587006:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048803.587089:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097783040 00000100:00100000:2.0:1789048803.587102:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097783040 00000100:00100000:2.0:1789048803.587242:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:2.0:1789048803.587255:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+19:15694:x1875953097783040:12345-192.168.202.16@tcp:49:bash.0 00000100:00100000:2.0:1789048803.587462:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+19:15694:x1875953097783040:12345-192.168.202.16@tcp:49:bash.0 Request processed in 209us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048803.587471:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:1.0:1789048803.587588:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08884a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17123:1875953111490304:192.168.202.16@tcp:105: 00010000:00010000:1.0:1789048803.587625:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776e3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.587639:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0800/0x133f221c087776e3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.587685:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c08777792 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.587703:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c08777792 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.587718:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c08777792 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.587729:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c08777792 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.587750:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c08777792 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.587757:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c08777792 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.587763:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07061c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048803.587768:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c08777792 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.587775:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c08777792 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.587789:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:1.0:1789048803.587792:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048803.587797:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c08777792 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.587803:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c08777792 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.587813:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777784 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.587820:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777784 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.587826:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777784 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.587832:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048803.587841:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777784 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.587849:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777784 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.587857:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:1.0:1789048803.587860:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789048803.587863:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777784 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.587869:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c800/0x133f221c08777784 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048803.588039:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+18:15695:x1875953097782656:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 27246us (27580us total) trans 8589934630 rc 0/0 00000100:00100000:1.0:1789048803.588049:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 70 00000020:00080000:1.0:1789048803.588053:0:17123:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789048803.589408:0:17157:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789048803.589419:0:17157:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789048803.589441:0:17157:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789048803.589448:0:17157:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789048803.592959:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048803.593028:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048803.593111:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097783168 00000100:00100000:1.0:1789048803.593125:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097783168 00000100:00100000:1.0:1789048803.593204:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:1.0:1789048803.593217:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+7:15694:x1875953097783168:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1789048803.593252:0:18631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048803.593281:0:18631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000098681c2/0x133f221c08777799 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c8f expref: -99 pid: 18631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789048803.593326:0:18631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x18d3fa68866c34c0, atime: 0x18d3fa67ffbb4401, ctime: 0x18d3fa68866c34c0, blocks: 0x0 00010000:00010000:1.0:1789048803.593390:0:18631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=558s v=(0 0) 00010000:00010000:1.0:1789048803.593396:0:18631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048803.593409:0:18631:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000098681c2/0x133f221c08777799 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c8f expref: 8 pid: 18631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.593429:0:18631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000098681c2/0x133f221c08777799 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c8f expref: 8 pid: 18631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.593445:0:18631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07060e00, rc 0) 00000100:00100000:1.0:1789048803.593519:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+8:15694:x1875953097783168:12345-192.168.202.16@tcp:101:bash.0 Request processed in 305us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048803.593525:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:0.0:1789048803.593893:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097783424 00000100:00100000:0.0:1789048803.593900:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097783424 00000100:00100000:0.0:1789048803.593950:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:0.0:1789048803.593959:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+18:15695:x1875953097783424:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789048803.594329:0:17126:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789048803.594407:0:17126:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00010000:00010000:0.0:1789048803.594447:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c087777a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.594465:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c087777a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.594477:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c087777a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.594487:0:17126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c087777a0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.594494:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c087777a0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.594500:0:17126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c087777a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048803.594544:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789048803.594903:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048803.594913:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c087777a0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.594920:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39000 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048803.594924:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c087777a0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.594933:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c087777a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.594947:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff959b06bfcc00) 00010000:00010000:3.0:1789048803.594950:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789048803.594955:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c087777a0 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.594962:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39000/0x133f221c087777a0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048803.594977:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048803.594979:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048803.594980:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048803.595160:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+20:15695:x1875953097783424:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 1198us (2212us total) trans 8589934632 rc 0/0 00000100:00100000:0.0:1789048803.595170:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00000020:00080000:0.0:1789048803.595176:0:17126:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789048803.600277:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048803.600380:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097783552 00000100:00100000:1.0:1789048803.600393:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097783552 00000100:00100000:1.0:1789048803.600475:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:1.0:1789048803.600487:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+20:15694:x1875953097783552:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1789048803.600526:0:17124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048803.600553:0:17124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c087777a7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c96 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.600672:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c087777ae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.600689:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c087777ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.600722:0:17124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c087777ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.600870:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c087777a7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c96 expref: 22 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.600894:0:17124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c087777ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c96 expref: 21 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.600905:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:1.0:1789048803.600908:0:17124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789048803.600912:0:17124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07061200, rc 0) 00000100:00100000:1.0:1789048803.601003:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+21:15694:x1875953097783552:12345-192.168.202.16@tcp:101:bash.0 Request processed in 518us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048803.601011:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:3.0:1789048803.604943:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048803.605080:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097783808 00000100:00100000:0.0:1789048803.605095:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097783808 00000100:00100000:0.0:1789048803.605169:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:0.0:1789048803.605193:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+21:15694:x1875953097783808:12345-192.168.202.16@tcp:35:bash.0 00000001:00080000:0.0:1789048803.605540:0:17126:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934633 00000001:00080000:0.0:1789048803.605643:0:17126:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934634 00000100:00100000:0.0:1789048803.605771:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+24:15694:x1875953097783808:12345-192.168.202.16@tcp:35:bash.0 Request processed in 590us (841us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1789048803.605780:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00000020:00080000:0.0:1789048803.605785:0:17126:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789048803.715646:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048803.715877:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097784064 00000100:00100000:1.0:1789048803.715890:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097784064 00000100:00100000:1.0:1789048803.715975:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 72 00000100:00100000:1.0:1789048803.715987:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+24:15705:x1875953097784064:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789048803.716020:0:19099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048803.716064:0:19099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c087777b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29c9d expref: -99 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048803.716214:0:19099:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789048803.716424:0:19099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c087777b5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c9d expref: 26 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.716467:0:19099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfcd00) 00010000:00010000:1.0:1789048803.716471:0:19099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789048803.716476:0:19099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c087777b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c9d expref: 26 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.716493:0:19099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07061c00, rc 0) 00000100:00100000:1.0:1789048803.716576:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+25:15705:x1875953097784064:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 590us (955us total) trans 8589934636 rc 301/301 00000100:00100000:1.0:1789048803.716585:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 72 00000100:00100000:2.0:1789048803.721298:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048803.721437:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097784192 00000100:00100000:1.0:1789048803.721450:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097784192 00000100:00100000:1.0:1789048803.721521:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 73 00000100:00100000:1.0:1789048803.721534:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+25:15705:x1875953097784192:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:1.0:1789048803.721665:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087777c3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.721687:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087777c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.721702:0:17124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087777c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.721722:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060a00/0x133f221c087777ca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.721730:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060a00/0x133f221c087777ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.721763:0:17124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060a00/0x133f221c087777ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.721862:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c087777d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.721872:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c087777d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.721880:0:17124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c087777d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789048803.721941:0:17124:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c087777d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.721957:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087777c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.721964:0:17124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087777c3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.721972:0:17124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087777c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.721979:0:17124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07061000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048803.721984:0:17124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087777c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.721992:0:17124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087777c3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.722008:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff959c3ef1e200) 00010000:00010000:1.0:1789048803.722017:0:17124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048803.722025:0:17124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087777c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.722031:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c087777c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.722062:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060a00/0x133f221c087777ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.722068:0:17124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060a00/0x133f221c087777ca lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.722074:0:17124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060a00/0x133f221c087777ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.722079:0:17124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07060a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048803.722082:0:17124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060a00/0x133f221c087777ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.722088:0:17124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060a00/0x133f221c087777ca lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.722095:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff959c3ef1f400) 00010000:00010000:1.0:1789048803.722098:0:17124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048803.722101:0:17124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060a00/0x133f221c087777ca lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.722106:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060a00/0x133f221c087777ca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.722120:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c087777d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.722131:0:17124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c087777d1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.722136:0:17124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c087777d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.722141:0:17124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07060400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048803.722144:0:17124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c087777d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.722149:0:17124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c087777d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.722156:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:1.0:1789048803.722159:0:17124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048803.722161:0:17124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c087777d1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048803.722167:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060400/0x133f221c087777d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048803.722276:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+25:15705:x1875953097784192:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 743us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048803.722285:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 73 00000100:00100000:3.0:1789048803.726109:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048803.726247:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097784448 00000100:00100000:0.0:1789048803.726260:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097784448 00000100:00100000:0.0:1789048803.726376:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:0.0:1789048803.726390:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+25:15705:x1875953097784448:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:0.0:1789048803.726772:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+26:15705:x1875953097784448:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 385us (680us total) trans 8589934637 rc 0/0 00000100:00100000:0.0:1789048803.726781:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00010000:00010000:3.0:1789048803.934099:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048804.318075:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111490432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789048804.318183:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048804.318423:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111490432 00000100:00100000:2.0:1789048804.318434:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111490432 00000100:00100000:2.0:1789048804.318534:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789048804.318545:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111490432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789048804.318576:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789048804.318640:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111490432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048804.318648:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1789048804.318794:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789048804.318974:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111490432:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1789048804.638446:0:17157:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789048804.638459:0:17157:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789048804.638487:0:17157:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789048804.638499:0:17157:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789048804.957664:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048805.355100:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789048805.355131:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111490560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789048805.355234:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048805.355298:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111490560 00000100:00100000:0.0:1789048805.355309:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111490560 00000100:00100000:0.0:1789048805.355391:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789048805.355415:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111490560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789048805.355463:0:17127:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789048805.355517:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111490560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048805.355526:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789048805.355578:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111490560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048805.853534:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111490688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789048805.853633:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048805.853714:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111490688 00000100:00100000:2.0:1789048805.853724:0:18100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111490688 00000100:00100000:2.0:1789048805.853789:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789048805.853800:0:18100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111490688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789048805.853847:0:18100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789048805.854271:0:18100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111490688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 470us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048805.854280:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789048805.854362:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111490688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048805.855000:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111490816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789048805.855063:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048805.855106:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111490816 00000100:00100000:1.0:1789048805.855112:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111490816 00000100:00100000:1.0:1789048805.855177:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789048805.855188:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875953111490816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789048805.855219:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789048805.855268:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875953111490816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048805.855276:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789048805.855297:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789048805.855374:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111490816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789048805.856599:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111490944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048805.856660:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048805.856723:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111490944 00000100:00100000:1.0:1789048805.856730:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111490944 00000100:00100000:1.0:1789048805.856780:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789048805.856788:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111490944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789048805.856807:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789048805.856845:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111490944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048805.856852:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1789048805.856890:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789048805.856921:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111490944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048805.869450:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111491200:0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.869555:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048805.869594:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111491712:0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.869620:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048805.869647:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789048805.869652:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111491328:0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.869673:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048805.869695:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111491840:0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.869714:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048805.869738:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111491456:0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.869758:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048805.869775:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111491968:0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.869805:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048805.869822:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789048805.869828:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3622:1875953111491072:0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.869854:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048805.869879:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111491584:0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.869896:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048805.869904:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111492096:0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.869920:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048805.869946:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111491200 00000100:00100000:0.0:1789048805.869955:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111491200 00000100:00100000:0.0:1789048805.870008:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111491456 00000100:00100000:0.0:1789048805.870010:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111491456 00000100:00100000:0.0:1789048805.870045:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789048805.870055:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111491200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.870113:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111491200:12345-0@lo:400:kworker.0 Request processed in 59us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048805.870121:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789048805.870150:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789048805.870165:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111491456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.870195:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111491456:12345-0@lo:400:kworker.0 Request processed in 40us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048805.870201:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789048805.870232:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111491712 00000100:00100000:0.0:1789048805.870235:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111491712 00000100:00100000:0.0:1789048805.870255:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111491328 00000100:00100000:0.0:1789048805.870258:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111491328 00000100:00100000:0.0:1789048805.870266:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111491840 00000100:00100000:0.0:1789048805.870274:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111491840 00000100:00100000:0.0:1789048805.870287:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111491968 00000100:00100000:0.0:1789048805.870289:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111491968 00000100:00100000:0.0:1789048805.870300:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111491584 00000100:00100000:0.0:1789048805.870302:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111491584 00000100:00100000:0.0:1789048805.870311:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111492096 00000100:00100000:0.0:1789048805.870313:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111492096 00000100:00100000:0.0:1789048805.870324:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789048805.870330:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111491712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.870396:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111491712:12345-0@lo:400:kworker.0 Request processed in 66us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048805.870402:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789048805.870414:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789048805.870420:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111491328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.870445:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111491328:12345-0@lo:400:kworker.0 Request processed in 26us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048805.870450:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789048805.870459:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789048805.870465:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111491840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.870488:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111491840:12345-0@lo:400:kworker.0 Request processed in 23us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048805.870493:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789048805.870503:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789048805.870508:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111491968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.870527:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111491968:12345-0@lo:400:kworker.0 Request processed in 20us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048805.870532:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789048805.870548:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789048805.870553:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111491584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.870574:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111491584:12345-0@lo:400:kworker.0 Request processed in 21us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048805.870580:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789048805.870588:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789048805.870594:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111492096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.870613:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111492096:12345-0@lo:400:kworker.0 Request processed in 20us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048805.870618:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789048805.870653:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111491328:0@lo:400:kworker.0 00010000:00080000:0.0:1789048805.870667:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b083b2a00 x1875953111491840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048805.870678:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111491840:0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.870687:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111491200:0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.870696:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111491712:0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.870731:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111491584:0@lo:400:kworker.0 00010000:00080000:0.0:1789048805.870739:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b083b1500 x1875953111492096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048805.870748:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111492096:0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.870755:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111491456:0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.870763:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111491968:0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.873319:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111491072 00000100:00100000:0.0:1789048805.873359:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111491072 00000100:00080000:1.0:1789048805.873419:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789048805.873427:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789048805.873432:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789048805.873436:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789048805.873450:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3622:x1875953111491072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048805.873647:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3622:x1875953111491072:12345-0@lo:400:kworker.0 Request processed in 200us (3790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048805.873658:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789048805.874054:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3622:1875953111491072:0@lo:400:kworker.0 00000001:02000400:0.0:1789048805.952637:0:20300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:3.0:1789048805.981706:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048807.005610:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048807.489828:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048807.489893:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048807.489930:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097784704 00000100:00100000:0.0:1789048807.489943:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097784704 00000100:00100000:0.0:1789048807.490020:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:0.0:1789048807.490035:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+8:2394:x1875953097784704:12345-192.168.202.16@tcp:16:kworker.0 00000100:00100000:0.0:1789048807.490206:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+8:2394:x1875953097784704:12345-192.168.202.16@tcp:16:kworker.0 Request processed in 175us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048807.490211:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097784576 00000100:00100000:0.0:1789048807.490218:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:3.0:1789048807.490219:0:18635:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097784576 00000100:00080000:0.0:1789048807.490248:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:3.0:1789048807.490252:0:18635:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff959b08109c00 x1875953097784576/t0(0) o4->a39ccd94-ab5b-4707-8ce7-49dceae587e6@192.168.202.16@tcp:63/0 lens 504/0 e 0 to 0 dl 1789048818 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789048807.490265:0:18635:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b08109c00 with x1875953097784576 ext(0->8) 00002000:00010000:3.0:1789048807.490271:0:18635:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff959b08109c00 00000100:00100000:3.0:1789048807.490292:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:3.0:1789048807.490300:0:18635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+8:2394:x1875953097784576:12345-192.168.202.16@tcp:4:bash.0 00000100:00100000:3.0:1789048807.491463:0:18635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+10:2394:x1875953097784576:12345-192.168.202.16@tcp:4:bash.0 Request processed in 1161us (1647us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789048807.491472:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00002000:00100000:3.0:1789048807.491480:0:18635:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff959b08109c00 x1875953097784576/t8589934599(0) o4->a39ccd94-ab5b-4707-8ce7-49dceae587e6@192.168.202.16@tcp:63/0 lens 504/448 e 0 to 0 dl 1789048818 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789048807.491488:0:18635:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b08109c00 with x1875953097784576 ext(0->8) 00002000:00010000:3.0:1789048807.491492:0:18635:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff959b08109c00 Debug log: 43499 lines, 43499 kept, 0 dropped, 0 bad.